Jun 03 15:46:19.069933 ip-10-0-139-72 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:46:19.069947 ip-10-0-139-72 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:46:19.069954 ip-10-0-139-72 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:46:19.070173 ip-10-0-139-72 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:46:29.245564 ip-10-0-139-72 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:46:29.245578 ip-10-0-139-72 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0c1c265f6d2e40aaa4cb068a4fbaf694 -- Jun 03 15:49:03.281635 ip-10-0-139-72 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:49:03.754913 ip-10-0-139-72 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:49:03.754913 ip-10-0-139-72 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:49:03.754913 ip-10-0-139-72 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:49:03.754913 ip-10-0-139-72 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:49:03.754913 ip-10-0-139-72 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:49:03.757267 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.757161 2582 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:49:03.760776 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760760 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760777 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760781 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760784 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760787 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760790 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760793 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760796 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760798 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760801 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760803 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760814 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:49:03.760812 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760817 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760820 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760822 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760825 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760827 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760830 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760833 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760835 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760838 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760840 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760843 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760845 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760848 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760850 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760854 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760857 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760860 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760863 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760865 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:49:03.761104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760868 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760870 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760872 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760875 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760877 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760880 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760882 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760885 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760887 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760890 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760892 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760895 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760897 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760900 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760903 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760906 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760909 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760912 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760914 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760917 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:49:03.761626 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760919 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760922 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760924 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760927 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760929 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760932 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760934 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760938 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760940 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760942 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760947 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760950 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760953 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760955 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760958 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760961 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760964 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760967 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760970 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760973 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:49:03.762123 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760976 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760978 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760981 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760984 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760986 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760989 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760991 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760995 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.760997 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761000 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761002 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761005 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761007 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761009 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761012 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761503 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761517 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761521 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761525 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761527 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:49:03.762619 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761530 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761533 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761536 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761539 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761542 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761545 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761547 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761550 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761552 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761555 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761557 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761560 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761564 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761568 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761571 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761574 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761576 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761579 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761581 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:49:03.763110 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761585 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761591 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761594 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761597 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761599 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761602 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761605 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761608 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761611 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761614 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761616 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761619 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761621 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761624 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761627 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761629 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761632 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761635 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761638 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761641 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:49:03.763578 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761644 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761647 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761651 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761653 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761656 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761659 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761662 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761664 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761667 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761669 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761672 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761674 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761676 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761679 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761682 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761684 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761687 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761690 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761692 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761695 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:49:03.764122 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761698 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761700 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761703 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761705 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761708 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761710 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761712 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761715 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761718 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761721 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761723 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761727 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761729 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761732 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761734 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761737 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761739 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761742 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761745 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761748 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:49:03.764610 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761751 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.761754 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762490 2582 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762500 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762509 2582 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762514 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762519 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762522 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762526 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762531 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762534 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762537 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762540 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762544 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762547 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762550 2582 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762553 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762556 2582 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762558 2582 flags.go:64] FLAG: --cloud-config="" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762561 2582 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762564 2582 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762568 2582 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762571 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762574 2582 flags.go:64] FLAG: --config-dir="" Jun 03 15:49:03.765090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762577 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762580 2582 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762584 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762590 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762593 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762596 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762600 2582 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762602 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762606 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762609 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762612 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762616 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762619 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762622 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762625 2582 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762628 2582 flags.go:64] FLAG: --enable-server="true" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762631 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762636 2582 flags.go:64] FLAG: --event-burst="100" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762639 2582 flags.go:64] FLAG: --event-qps="50" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762642 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762646 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762648 2582 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762652 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762655 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762658 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:49:03.765732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762661 2582 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762664 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762667 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762669 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762672 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762675 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762679 2582 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762681 2582 flags.go:64] FLAG: --feature-gates="" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762685 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762688 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762692 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762695 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762698 2582 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762701 2582 flags.go:64] FLAG: --help="false" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762704 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-139-72.ec2.internal" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762707 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762711 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762714 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762717 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762720 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762723 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762725 2582 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762728 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:49:03.766348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762730 2582 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762733 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762736 2582 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762739 2582 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762742 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762744 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762747 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762750 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762752 2582 flags.go:64] FLAG: --lock-file="" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762755 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762758 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762761 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762766 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762769 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762772 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762774 2582 flags.go:64] FLAG: --logging-format="text" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762777 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762780 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762783 2582 flags.go:64] FLAG: --manifest-url="" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762786 2582 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762790 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762793 2582 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762801 2582 flags.go:64] FLAG: --max-pods="110" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762804 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762807 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:49:03.766907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762810 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762813 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762816 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762819 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762822 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762830 2582 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762833 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762836 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762839 2582 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762842 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762847 2582 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762850 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762853 2582 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762856 2582 flags.go:64] FLAG: --port="10250" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762859 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762862 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03c823f0c7fe18a41" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762865 2582 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762868 2582 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762871 2582 flags.go:64] FLAG: --register-node="true" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762874 2582 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762877 2582 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762881 2582 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762883 2582 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762886 2582 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762889 2582 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:49:03.767514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762893 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762895 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762899 2582 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762902 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762906 2582 flags.go:64] FLAG: --runonce="false" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762908 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762911 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762914 2582 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762917 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762921 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762924 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762927 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762929 2582 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762932 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762935 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762937 2582 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762940 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762943 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762946 2582 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762948 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762954 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762957 2582 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762959 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762964 2582 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762966 2582 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:49:03.768099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762969 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762972 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762974 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762977 2582 flags.go:64] FLAG: --v="2" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762981 2582 flags.go:64] FLAG: --version="false" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762985 2582 flags.go:64] FLAG: --vmodule="" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762990 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.762993 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763082 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763086 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763091 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763094 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763097 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763100 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763102 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763105 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763107 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763110 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763113 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763116 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763118 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:49:03.768705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763121 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763124 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763126 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763128 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763131 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763133 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763135 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763138 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763140 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763142 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763145 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763147 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763150 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763152 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763155 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763157 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763160 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763162 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763164 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763168 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:49:03.769214 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763171 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763175 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763177 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763180 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763182 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763185 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763187 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763190 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763193 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763195 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763198 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763201 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763203 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763205 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763208 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763210 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763213 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763215 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763218 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763220 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:49:03.769777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763223 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763225 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763228 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763230 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763232 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763235 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763237 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763240 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763244 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763248 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763250 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763254 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763271 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763275 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763277 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763280 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763283 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763286 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763288 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:49:03.770500 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763291 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763293 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763297 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763301 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763304 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763307 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763310 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763313 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763315 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763318 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763320 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763323 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763326 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.763328 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:49:03.771235 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.764211 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:49:03.772475 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.772453 2582 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:49:03.772475 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.772477 2582 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:49:03.772531 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772526 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772531 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772535 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772538 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772540 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772543 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772546 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772549 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772552 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772554 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772557 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772560 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:49:03.772558 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772562 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772565 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772568 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772571 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772573 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772576 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772578 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772581 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772584 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772589 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772592 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772594 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772597 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772599 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772602 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772604 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772607 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772610 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772612 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:49:03.772856 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772614 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772617 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772619 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772621 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772624 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772626 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772629 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772631 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772633 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772636 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772639 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772641 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772643 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772646 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772648 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772652 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772654 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772656 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772659 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772661 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:49:03.773331 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772664 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772666 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772669 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772671 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772674 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772676 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772679 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772681 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772685 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772688 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772691 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772694 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772697 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772699 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772702 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772705 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772707 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772710 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772712 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:49:03.773817 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772714 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772717 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772720 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772723 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772725 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772728 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772731 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772733 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772737 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772739 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772741 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772744 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772746 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772749 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772751 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:49:03.774298 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772753 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.772758 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772855 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772860 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772863 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772866 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772870 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772874 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772876 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772879 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772882 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772884 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772887 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772889 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772891 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:49:03.774669 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772894 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772897 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772901 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772904 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772906 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772909 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772911 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772914 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772916 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772919 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772922 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772924 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772926 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772929 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772931 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772934 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772937 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772939 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772941 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:49:03.775035 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772943 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772946 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772948 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772950 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772953 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772955 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772957 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772959 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772962 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772964 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772967 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772969 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772971 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772974 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772976 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772978 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772981 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772983 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772986 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772988 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:49:03.775507 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772991 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772993 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.772996 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773000 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773002 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773005 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773007 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773009 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773012 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773014 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773017 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773019 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773021 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773024 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773026 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773029 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773031 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773033 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773036 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773038 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:49:03.775993 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773041 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773043 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773046 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773048 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773051 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773053 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773055 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773058 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773060 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773062 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773065 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773067 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773069 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:03.773072 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.773077 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:49:03.776639 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.773184 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:49:03.777405 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.777391 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:49:03.778367 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.778356 2582 server.go:1019] "Starting client certificate rotation" Jun 03 15:49:03.778480 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.778461 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:49:03.778512 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.778502 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:49:03.804951 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.804928 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:49:03.807859 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.807838 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:49:03.828980 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.828960 2582 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:49:03.837559 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.837538 2582 log.go:25] "Validated CRI v1 image API" Jun 03 15:49:03.840053 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.840037 2582 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:49:03.846384 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.846203 2582 fs.go:135] Filesystem UUIDs: map[10a1b60b-8ac5-46dd-8c75-61342c7286af:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f7130fca-b534-46d3-8407-8cb890e680e2:/dev/nvme0n1p3] Jun 03 15:49:03.846384 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.846376 2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:49:03.846479 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.846383 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:49:03.851985 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.851869 2582 manager.go:217] Machine: {Timestamp:2026-06-03 15:49:03.851345912 +0000 UTC m=+0.447105597 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099917 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec253f32ef7d290c6165dfeb20f42394 SystemUUID:ec253f32-ef7d-290c-6165-dfeb20f42394 BootID:0c1c265f-6d2e-40aa-a4cb-068a4fbaf694 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:ca:71:9a:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:ca:71:9a:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:11:46:78:6e:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:49:03.852603 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.852591 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:49:03.852696 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.852684 2582 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:49:03.854643 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.854612 2582 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:49:03.854816 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.854647 2582 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:49:03.854908 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.854830 2582 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:49:03.854908 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.854843 2582 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:49:03.854908 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.854854 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:49:03.855503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.855489 2582 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:49:03.856369 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.856356 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:49:03.856502 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.856491 2582 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:49:03.858892 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.858880 2582 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:49:03.858949 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.858899 2582 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:49:03.858949 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.858916 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:49:03.858949 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.858930 2582 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:49:03.858949 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.858942 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:49:03.859977 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.859963 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:49:03.860099 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.859987 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:49:03.863161 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.863146 2582 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:49:03.865092 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.865078 2582 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:49:03.868729 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868716 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868734 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868741 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868747 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868755 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868761 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868767 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868776 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868783 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:49:03.868785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868788 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:49:03.869016 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868798 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:49:03.869016 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.868803 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:49:03.869931 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.869918 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:49:03.869981 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.869935 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:49:03.870564 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.870531 2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:49:03.870650 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.870628 2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:49:03.875403 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.875391 2582 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:49:03.875462 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.875427 2582 server.go:1295] "Started kubelet" Jun 03 15:49:03.875560 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.875511 2582 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:49:03.875614 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.875529 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:49:03.875614 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.875583 2582 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:49:03.876294 ip-10-0-139-72 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:49:03.877426 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.877410 2582 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:49:03.878314 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.878293 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r9vp8" Jun 03 15:49:03.879350 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.879337 2582 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:49:03.880198 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.880184 2582 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:49:03.888083 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.888065 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r9vp8" Jun 03 15:49:03.889086 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.889065 2582 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:49:03.889669 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.888498 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-72.ec2.internal.18b59ce70da82f3d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-72.ec2.internal,UID:ip-10-0-139-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-72.ec2.internal,},FirstTimestamp:2026-06-03 15:49:03.875403581 +0000 UTC m=+0.471163265,LastTimestamp:2026-06-03 15:49:03.875403581 +0000 UTC m=+0.471163265,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-72.ec2.internal,}" Jun 03 15:49:03.891025 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.891004 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:49:03.891921 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.891908 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:49:03.891990 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.891981 2582 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:49:03.892037 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.891994 2582 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:49:03.892037 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.892016 2582 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:49:03.897788 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.897766 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:03.897880 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.897791 2582 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:49:03.897880 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.897805 2582 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:49:03.897984 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.897911 2582 factory.go:55] Registering systemd factory Jun 03 15:49:03.897984 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.897924 2582 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:49:03.898158 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.898146 2582 factory.go:153] Registering CRI-O factory Jun 03 15:49:03.898198 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.898161 2582 factory.go:223] Registration of the crio container factory successfully Jun 03 15:49:03.898236 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.898202 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:49:03.898236 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.898215 2582 factory.go:103] Registering Raw factory Jun 03 15:49:03.898236 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.898228 2582 manager.go:1196] Started watching for new ooms in manager Jun 03 15:49:03.898632 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.898620 2582 manager.go:319] Starting recovery of all containers Jun 03 15:49:03.907248 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.907090 2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:03.909043 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.909023 2582 manager.go:324] Recovery completed Jun 03 15:49:03.911554 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.911531 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-72.ec2.internal\" not found" node="ip-10-0-139-72.ec2.internal" Jun 03 15:49:03.913487 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.913466 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:03.915568 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.915552 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:03.915637 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.915580 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:03.915637 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.915591 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:03.916128 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.916111 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:49:03.916128 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.916125 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:49:03.916279 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.916145 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:49:03.919059 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.919044 2582 policy_none.go:49] "None policy: Start" Jun 03 15:49:03.919144 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.919067 2582 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:49:03.919144 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.919080 2582 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:49:03.950827 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.950805 2582 manager.go:341] "Starting Device Plugin manager" Jun 03 15:49:03.950983 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.950840 2582 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:49:03.950983 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.950853 2582 server.go:85] "Starting device plugin registration server" Jun 03 15:49:03.951119 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.951107 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:49:03.951181 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.951121 2582 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:49:03.951238 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.951191 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:49:03.951318 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.951286 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:49:03.951318 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:03.951295 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:49:03.951934 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.951915 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:49:03.952023 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:03.951948 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.028486 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.028412 2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:49:04.029804 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.029791 2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:49:04.029875 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.029817 2582 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:49:04.029875 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.029834 2582 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:49:04.029875 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.029841 2582 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:49:04.029992 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.029881 2582 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:49:04.033155 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.033135 2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:04.051377 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.051356 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:04.052421 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.052406 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:04.052502 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.052437 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:04.052502 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.052449 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:04.052502 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.052471 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.061690 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.061669 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.061753 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.061693 2582 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-72.ec2.internal\": node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.076793 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.076773 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.130420 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.130387 2582 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal"] Jun 03 15:49:04.130565 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.130469 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:04.132303 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.132288 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:04.132399 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.132321 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:04.132399 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.132333 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:04.133614 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.133601 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:04.133779 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.133764 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.133874 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.133801 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:04.134272 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.134244 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:04.134344 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.134287 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:04.134344 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.134298 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:04.134344 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.134336 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:04.134482 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.134360 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:04.134482 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.134375 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:04.135713 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.135697 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.135788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.135725 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:49:04.136448 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.136431 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:49:04.136532 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.136463 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:49:04.136532 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.136477 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:49:04.160876 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.160849 2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-72.ec2.internal\" not found" node="ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.165129 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.165111 2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-72.ec2.internal\" not found" node="ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.177184 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.177161 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.200254 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.200234 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf6fe2708a04c0590747b24b7dfe25f1-config\") pod \"kube-apiserver-proxy-ip-10-0-139-72.ec2.internal\" (UID: \"bf6fe2708a04c0590747b24b7dfe25f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.200353 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.200270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af853be8510a56e46e69663383e34ba0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal\" (UID: \"af853be8510a56e46e69663383e34ba0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.200353 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.200289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af853be8510a56e46e69663383e34ba0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal\" (UID: \"af853be8510a56e46e69663383e34ba0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.278156 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.278128 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.301165 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.301117 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af853be8510a56e46e69663383e34ba0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal\" (UID: \"af853be8510a56e46e69663383e34ba0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.301165 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.301145 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af853be8510a56e46e69663383e34ba0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal\" (UID: \"af853be8510a56e46e69663383e34ba0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.301315 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.301165 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf6fe2708a04c0590747b24b7dfe25f1-config\") pod \"kube-apiserver-proxy-ip-10-0-139-72.ec2.internal\" (UID: \"bf6fe2708a04c0590747b24b7dfe25f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.301315 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.301201 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bf6fe2708a04c0590747b24b7dfe25f1-config\") pod \"kube-apiserver-proxy-ip-10-0-139-72.ec2.internal\" (UID: \"bf6fe2708a04c0590747b24b7dfe25f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.301315 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.301204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af853be8510a56e46e69663383e34ba0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal\" (UID: \"af853be8510a56e46e69663383e34ba0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.301315 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.301237 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af853be8510a56e46e69663383e34ba0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal\" (UID: \"af853be8510a56e46e69663383e34ba0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.378592 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.378562 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.464031 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.464003 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.469641 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.469614 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" Jun 03 15:49:04.479525 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.479508 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.580110 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.580010 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.680541 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.680492 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.779111 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.779076 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:49:04.779746 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.779281 2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:49:04.779746 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.779283 2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:49:04.781245 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.781218 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.881399 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:04.881321 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-72.ec2.internal\" not found" Jun 03 15:49:04.891661 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.891633 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:49:04.891805 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.891633 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 15:44:03 +0000 UTC" deadline="2027-11-04 11:37:20.490875628 +0000 UTC" Jun 03 15:49:04.891805 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.891742 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12451h48m15.599138006s" Jun 03 15:49:04.899819 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.898355 2582 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:04.904458 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.904434 2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:49:04.920777 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:04.920752 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6fe2708a04c0590747b24b7dfe25f1.slice/crio-dabc175a1418baaa7d91a7a9607ec7a83e260ebb0df188eb4c87fa22f7a62eef WatchSource:0}: Error finding container dabc175a1418baaa7d91a7a9607ec7a83e260ebb0df188eb4c87fa22f7a62eef: Status 404 returned error can't find the container with id dabc175a1418baaa7d91a7a9607ec7a83e260ebb0df188eb4c87fa22f7a62eef Jun 03 15:49:04.924462 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.924448 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:49:04.928069 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.928051 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pctzq" Jun 03 15:49:04.937831 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.937814 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pctzq" Jun 03 15:49:04.983146 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:04.983118 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf853be8510a56e46e69663383e34ba0.slice/crio-ccbecaf2770d2d59136455485515c7c7653d2efce2eebfdc0cf22dbcb67f43d8 WatchSource:0}: Error finding container ccbecaf2770d2d59136455485515c7c7653d2efce2eebfdc0cf22dbcb67f43d8: Status 404 returned error can't find the container with id ccbecaf2770d2d59136455485515c7c7653d2efce2eebfdc0cf22dbcb67f43d8 Jun 03 15:49:04.993046 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:04.993023 2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" Jun 03 15:49:05.006483 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.006458 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:49:05.008107 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.008094 2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" Jun 03 15:49:05.020097 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.020079 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:49:05.032921 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.032879 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" event={"ID":"af853be8510a56e46e69663383e34ba0","Type":"ContainerStarted","Data":"ccbecaf2770d2d59136455485515c7c7653d2efce2eebfdc0cf22dbcb67f43d8"} Jun 03 15:49:05.033825 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.033804 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" event={"ID":"bf6fe2708a04c0590747b24b7dfe25f1","Type":"ContainerStarted","Data":"dabc175a1418baaa7d91a7a9607ec7a83e260ebb0df188eb4c87fa22f7a62eef"} Jun 03 15:49:05.456162 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.456132 2582 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:05.860552 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.860466 2582 apiserver.go:52] "Watching apiserver" Jun 03 15:49:05.876206 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.876182 2582 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:49:05.878250 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.878218 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n","openshift-cluster-node-tuning-operator/tuned-knn7w","openshift-multus/multus-q24c4","openshift-dns/node-resolver-nz2nn","openshift-image-registry/node-ca-hvzs4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal","openshift-multus/multus-additional-cni-plugins-2l9nk","openshift-multus/network-metrics-daemon-5t5zt","openshift-network-diagnostics/network-check-target-s89rk","openshift-network-operator/iptables-alerter-lp5s5","openshift-ovn-kubernetes/ovnkube-node-vfxr7","kube-system/konnectivity-agent-j5gdd"] Jun 03 15:49:05.879876 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.879841 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.881057 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.881037 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.882974 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.882951 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.883088 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.883040 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:49:05.883169 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.883149 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:49:05.883314 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.883300 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g8qkb\"" Jun 03 15:49:05.883508 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.883490 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:49:05.883581 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.883568 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:49:05.884134 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.884118 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:05.884420 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.884406 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:49:05.884544 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.884530 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d5tq9\"" Jun 03 15:49:05.886613 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.886569 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:05.887432 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.887412 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:49:05.889763 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.889293 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:49:05.889763 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.889379 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:49:05.889763 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.889297 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:49:05.889763 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.889593 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6qd2k\"" Jun 03 15:49:05.889763 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.889715 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:49:05.889763 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.889751 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9g5tn\"" Jun 03 15:49:05.890149 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.890121 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.891368 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.891211 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:49:05.891368 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.891211 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:49:05.891368 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.891322 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h2nwq\"" Jun 03 15:49:05.891368 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.891330 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:49:05.891619 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.891373 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:49:05.891856 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.891837 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:05.891944 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.891927 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:05.892098 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:05.892069 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:05.892232 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:05.892210 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:05.893989 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.893973 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:05.895334 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.895313 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kfxbg\"" Jun 03 15:49:05.895438 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.895398 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:49:05.895438 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.895430 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:49:05.897457 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.897439 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:05.898166 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.898147 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rpwz4\"" Jun 03 15:49:05.898298 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.898183 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:49:05.898541 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.898523 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:49:05.898621 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.898589 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:49:05.899044 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.899026 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:05.899968 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.899937 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:49:05.900082 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.900061 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:49:05.900350 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.900334 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:49:05.900932 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.900913 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:49:05.902285 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.902244 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:49:05.902725 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.902617 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:49:05.902853 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.902834 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:49:05.902853 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.902847 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:49:05.903059 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.903033 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rf6qh\"" Jun 03 15:49:05.903320 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.903304 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f72f9\"" Jun 03 15:49:05.909450 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909428 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-device-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.909609 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.909736 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-kubernetes\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.909870 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d3cb6c4-597f-46bf-8647-da28719643fc-tmp\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.909967 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909885 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v78hv\" (UniqueName: \"kubernetes.io/projected/162dba91-9a68-4519-8600-44268d7e92cb-kube-api-access-v78hv\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.909967 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909910 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8787a4-9a3d-4633-815d-8bfea72d7d11-tmp-dir\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:05.909967 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909932 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-kubelet\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.909967 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-conf-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.910174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.909982 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-system-cni-dir\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.910174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj6gx\" (UniqueName: \"kubernetes.io/projected/a06b5c81-587c-47ae-930a-981b833dca4e-kube-api-access-tj6gx\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:05.910174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910036 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-socket-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.910174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-cnibin\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.910174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910082 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-os-release\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.910174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-k8s-cni-cncf-io\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-multus-certs\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d547784-0771-4962-8bd6-3978f1f12270-serviceca\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910276 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-host\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910300 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz9w5\" (UniqueName: \"kubernetes.io/projected/1ce75af7-452d-4ffc-9116-2fe1a407343c-kube-api-access-dz9w5\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910345 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysctl-conf\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-sys\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910410 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-tuned\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-cnibin\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910463 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d547784-0771-4962-8bd6-3978f1f12270-host\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:05.910481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dscn\" (UniqueName: \"kubernetes.io/projected/4d547784-0771-4962-8bd6-3978f1f12270-kube-api-access-6dscn\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910506 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-modprobe-d\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910532 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-registration-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-cni-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-os-release\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-run\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-lib-modules\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910644 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z497\" (UniqueName: \"kubernetes.io/projected/4d3cb6c4-597f-46bf-8647-da28719643fc-kube-api-access-6z497\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-netns\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-cni-bin\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9c5c\" (UniqueName: \"kubernetes.io/projected/3b8787a4-9a3d-4633-815d-8bfea72d7d11-kube-api-access-q9c5c\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clc67\" (UniqueName: \"kubernetes.io/projected/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-kube-api-access-clc67\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-systemd\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910883 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-system-cni-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910923 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.911011 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vptsq\" (UniqueName: \"kubernetes.io/projected/ca4f5810-9958-46a9-8967-129c6517bf3f-kube-api-access-vptsq\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.910988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162dba91-9a68-4519-8600-44268d7e92cb-cni-binary-copy\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911059 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-cni-multus\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911105 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/162dba91-9a68-4519-8600-44268d7e92cb-multus-daemon-config\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a06b5c81-587c-47ae-930a-981b833dca4e-iptables-alerter-script\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-hostroot\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06b5c81-587c-47ae-930a-981b833dca4e-host-slash\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911295 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-var-lib-kubelet\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911315 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysctl-d\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911375 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-socket-dir-parent\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-etc-kubernetes\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-sys-fs\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysconfig\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:05.911771 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.911472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b8787a4-9a3d-4633-815d-8bfea72d7d11-hosts-file\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:05.938315 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.938286 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:44:04 +0000 UTC" deadline="2028-01-19 23:20:15.685417907 +0000 UTC" Jun 03 15:49:05.938315 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.938314 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14287h31m9.747107226s" Jun 03 15:49:05.995444 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:05.995407 2582 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:49:06.011720 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011672 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.011720 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011721 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vptsq\" (UniqueName: \"kubernetes.io/projected/ca4f5810-9958-46a9-8967-129c6517bf3f-kube-api-access-vptsq\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.011957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011756 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.011957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.011957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011853 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162dba91-9a68-4519-8600-44268d7e92cb-cni-binary-copy\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.011957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011876 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-cni-multus\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.011957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011901 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/162dba91-9a68-4519-8600-44268d7e92cb-multus-daemon-config\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.011957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011923 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.011983 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-cni-multus\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012009 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a06b5c81-587c-47ae-930a-981b833dca4e-iptables-alerter-script\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012050 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-hostroot\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012080 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22772c03-b3eb-4adc-9506-a2c893508a04-agent-certs\") pod \"konnectivity-agent-j5gdd\" (UID: \"22772c03-b3eb-4adc-9506-a2c893508a04\") " pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.012090 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012109 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06b5c81-587c-47ae-930a-981b833dca4e-host-slash\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012135 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-var-lib-kubelet\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovnkube-config\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.012232 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.012211 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs podName:b4ed3727-e0a3-4df1-91e4-cdaa043a854f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:06.512161879 +0000 UTC m=+3.107921551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs") pod "network-metrics-daemon-5t5zt" (UID: "b4ed3727-e0a3-4df1-91e4-cdaa043a854f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012244 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-hostroot\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012313 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a06b5c81-587c-47ae-930a-981b833dca4e-host-slash\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-var-lib-kubelet\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012359 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-env-overrides\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012383 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012406 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovn-node-metrics-cert\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012435 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012479 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysctl-d\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012493 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162dba91-9a68-4519-8600-44268d7e92cb-cni-binary-copy\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012521 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/162dba91-9a68-4519-8600-44268d7e92cb-multus-daemon-config\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012608 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-socket-dir-parent\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.012649 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012656 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-etc-kubernetes\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a06b5c81-587c-47ae-930a-981b833dca4e-iptables-alerter-script\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012692 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysctl-d\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012711 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-socket-dir-parent\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012709 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-etc-kubernetes\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012780 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-sys-fs\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012807 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysconfig\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012832 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b8787a4-9a3d-4633-815d-8bfea72d7d11-hosts-file\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012839 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-sys-fs\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012876 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysconfig\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012859 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-cni-bin\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012886 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b8787a4-9a3d-4633-815d-8bfea72d7d11-hosts-file\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012941 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-device-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012966 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012991 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-kubernetes\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.013192 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.012997 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-device-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013016 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d3cb6c4-597f-46bf-8647-da28719643fc-tmp\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013042 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v78hv\" (UniqueName: \"kubernetes.io/projected/162dba91-9a68-4519-8600-44268d7e92cb-kube-api-access-v78hv\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013065 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8787a4-9a3d-4633-815d-8bfea72d7d11-tmp-dir\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013069 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-kubernetes\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-node-log\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013119 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013119 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-kubelet\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013154 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-conf-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013156 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-kubelet\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013188 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-conf-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013179 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-system-cni-dir\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013206 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-system-cni-dir\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013229 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tj6gx\" (UniqueName: \"kubernetes.io/projected/a06b5c81-587c-47ae-930a-981b833dca4e-kube-api-access-tj6gx\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013300 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-socket-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013307 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013327 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-cnibin\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013346 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8787a4-9a3d-4633-815d-8bfea72d7d11-tmp-dir\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:06.013896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013351 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-os-release\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-cnibin\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013389 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-k8s-cni-cncf-io\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013407 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-os-release\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013428 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013444 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-socket-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013454 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-multus-certs\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013446 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-k8s-cni-cncf-io\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-etc-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013509 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-multus-certs\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013525 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013545 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013546 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d547784-0771-4962-8bd6-3978f1f12270-serviceca\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013574 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-host\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-slash\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013624 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22772c03-b3eb-4adc-9506-a2c893508a04-konnectivity-ca\") pod \"konnectivity-agent-j5gdd\" (UID: \"22772c03-b3eb-4adc-9506-a2c893508a04\") " pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013634 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-host\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.014660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013650 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013673 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9w5\" (UniqueName: \"kubernetes.io/projected/1ce75af7-452d-4ffc-9116-2fe1a407343c-kube-api-access-dz9w5\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013727 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysctl-conf\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013752 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-sys\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013773 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-tuned\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013798 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-cnibin\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013820 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d547784-0771-4962-8bd6-3978f1f12270-host\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013843 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dscn\" (UniqueName: \"kubernetes.io/projected/4d547784-0771-4962-8bd6-3978f1f12270-kube-api-access-6dscn\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013866 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-modprobe-d\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013891 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-registration-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013896 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-cnibin\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013919 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-cni-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013947 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-kubelet\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013974 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-systemd\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.013998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-log-socket\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014016 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014028 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-sysctl-conf\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxgp4\" (UniqueName: \"kubernetes.io/projected/93574a4f-2ef5-4fdf-b043-22f427e422c3-kube-api-access-zxgp4\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014074 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d547784-0771-4962-8bd6-3978f1f12270-host\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014084 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-os-release\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014105 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ce75af7-452d-4ffc-9116-2fe1a407343c-registration-dir\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014114 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-run\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014123 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-modprobe-d\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014146 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-sys\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014144 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-lib-modules\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014171 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z497\" (UniqueName: \"kubernetes.io/projected/4d3cb6c4-597f-46bf-8647-da28719643fc-kube-api-access-6z497\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-multus-cni-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014189 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-netns\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014236 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-cni-bin\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014242 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca4f5810-9958-46a9-8967-129c6517bf3f-os-release\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014302 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-run\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014305 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-var-lib-cni-bin\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014333 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-host-run-netns\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014397 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d547784-0771-4962-8bd6-3978f1f12270-serviceca\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014420 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9c5c\" (UniqueName: \"kubernetes.io/projected/3b8787a4-9a3d-4633-815d-8bfea72d7d11-kube-api-access-q9c5c\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:06.015788 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-run-netns\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014475 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clc67\" (UniqueName: \"kubernetes.io/projected/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-kube-api-access-clc67\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-ovn\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-cni-netd\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014660 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovnkube-script-lib\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014690 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014714 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-systemd\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014737 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-system-cni-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014764 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-systemd-units\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014790 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-var-lib-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014815 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162dba91-9a68-4519-8600-44268d7e92cb-system-cni-dir\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014819 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-systemd\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.014953 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d3cb6c4-597f-46bf-8647-da28719643fc-lib-modules\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.016476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.015185 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca4f5810-9958-46a9-8967-129c6517bf3f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.016914 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.016631 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d3cb6c4-597f-46bf-8647-da28719643fc-etc-tuned\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.018613 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.018583 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d3cb6c4-597f-46bf-8647-da28719643fc-tmp\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.021984 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.021966 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:06.021984 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.021986 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:06.021984 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.021995 2582 projected.go:194] Error preparing data for projected volume kube-api-access-nbfxk for pod openshift-network-diagnostics/network-check-target-s89rk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:06.022147 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.022052 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk podName:7f30f556-2f07-43d5-8577-8c9d8129efd8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:06.52203535 +0000 UTC m=+3.117795028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nbfxk" (UniqueName: "kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk") pod "network-check-target-s89rk" (UID: "7f30f556-2f07-43d5-8577-8c9d8129efd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:06.027500 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.027376 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vptsq\" (UniqueName: \"kubernetes.io/projected/ca4f5810-9958-46a9-8967-129c6517bf3f-kube-api-access-vptsq\") pod \"multus-additional-cni-plugins-2l9nk\" (UID: \"ca4f5810-9958-46a9-8967-129c6517bf3f\") " pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.027500 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.027468 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clc67\" (UniqueName: \"kubernetes.io/projected/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-kube-api-access-clc67\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:06.027711 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.027676 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj6gx\" (UniqueName: \"kubernetes.io/projected/a06b5c81-587c-47ae-930a-981b833dca4e-kube-api-access-tj6gx\") pod \"iptables-alerter-lp5s5\" (UID: \"a06b5c81-587c-47ae-930a-981b833dca4e\") " pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:06.028810 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.028788 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z497\" (UniqueName: \"kubernetes.io/projected/4d3cb6c4-597f-46bf-8647-da28719643fc-kube-api-access-6z497\") pod \"tuned-knn7w\" (UID: \"4d3cb6c4-597f-46bf-8647-da28719643fc\") " pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.028906 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.028844 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9c5c\" (UniqueName: \"kubernetes.io/projected/3b8787a4-9a3d-4633-815d-8bfea72d7d11-kube-api-access-q9c5c\") pod \"node-resolver-nz2nn\" (UID: \"3b8787a4-9a3d-4633-815d-8bfea72d7d11\") " pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:06.029160 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.029145 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v78hv\" (UniqueName: \"kubernetes.io/projected/162dba91-9a68-4519-8600-44268d7e92cb-kube-api-access-v78hv\") pod \"multus-q24c4\" (UID: \"162dba91-9a68-4519-8600-44268d7e92cb\") " pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.030228 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.030210 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9w5\" (UniqueName: \"kubernetes.io/projected/1ce75af7-452d-4ffc-9116-2fe1a407343c-kube-api-access-dz9w5\") pod \"aws-ebs-csi-driver-node-rqh6n\" (UID: \"1ce75af7-452d-4ffc-9116-2fe1a407343c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.030334 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.030306 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dscn\" (UniqueName: \"kubernetes.io/projected/4d547784-0771-4962-8bd6-3978f1f12270-kube-api-access-6dscn\") pod \"node-ca-hvzs4\" (UID: \"4d547784-0771-4962-8bd6-3978f1f12270\") " pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115495 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-kubelet\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115547 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-systemd\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115572 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-log-socket\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115599 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxgp4\" (UniqueName: \"kubernetes.io/projected/93574a4f-2ef5-4fdf-b043-22f427e422c3-kube-api-access-zxgp4\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115641 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-run-netns\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115678 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-ovn\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115701 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-cni-netd\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115724 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovnkube-script-lib\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115752 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-systemd-units\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115783 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-var-lib-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115842 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22772c03-b3eb-4adc-9506-a2c893508a04-agent-certs\") pod \"konnectivity-agent-j5gdd\" (UID: \"22772c03-b3eb-4adc-9506-a2c893508a04\") " pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115869 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovnkube-config\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115893 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-env-overrides\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115917 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovn-node-metrics-cert\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115953 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.115983 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-cni-bin\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.116347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116029 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116063 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-node-log\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116102 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-etc-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116196 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116635 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-var-lib-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116666 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116697 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-kubelet\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116725 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-run-netns\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116787 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-cni-netd\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116827 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-systemd\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117023 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-log-socket\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117624 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117301 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovnkube-script-lib\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117624 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.116739 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-ovn\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117624 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117372 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-systemd-units\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117796 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117723 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117796 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117780 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-cni-bin\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-env-overrides\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117873 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-etc-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117989 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117895 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-node-log\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.117989 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117959 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-slash\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.118074 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.117991 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22772c03-b3eb-4adc-9506-a2c893508a04-konnectivity-ca\") pod \"konnectivity-agent-j5gdd\" (UID: \"22772c03-b3eb-4adc-9506-a2c893508a04\") " pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:06.118728 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.118632 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-host-slash\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.118856 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.118817 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovnkube-config\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.119438 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.118018 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93574a4f-2ef5-4fdf-b043-22f427e422c3-run-openvswitch\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.121984 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.119521 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/22772c03-b3eb-4adc-9506-a2c893508a04-konnectivity-ca\") pod \"konnectivity-agent-j5gdd\" (UID: \"22772c03-b3eb-4adc-9506-a2c893508a04\") " pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:06.121984 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.120457 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/22772c03-b3eb-4adc-9506-a2c893508a04-agent-certs\") pod \"konnectivity-agent-j5gdd\" (UID: \"22772c03-b3eb-4adc-9506-a2c893508a04\") " pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:06.122548 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.122528 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93574a4f-2ef5-4fdf-b043-22f427e422c3-ovn-node-metrics-cert\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.128311 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.128280 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxgp4\" (UniqueName: \"kubernetes.io/projected/93574a4f-2ef5-4fdf-b043-22f427e422c3-kube-api-access-zxgp4\") pod \"ovnkube-node-vfxr7\" (UID: \"93574a4f-2ef5-4fdf-b043-22f427e422c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.192019 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.191981 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" Jun 03 15:49:06.199996 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.199966 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nz2nn" Jun 03 15:49:06.208137 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.208113 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-knn7w" Jun 03 15:49:06.212755 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.212732 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q24c4" Jun 03 15:49:06.220348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.220329 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hvzs4" Jun 03 15:49:06.226834 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.226816 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" Jun 03 15:49:06.233341 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.233319 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lp5s5" Jun 03 15:49:06.239966 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.239942 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:06.243658 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.243633 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:06.249971 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.249950 2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:06.382108 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.382034 2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:49:06.469705 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:06.469673 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3cb6c4_597f_46bf_8647_da28719643fc.slice/crio-351a03e47f3d4073e93407e2cc58d05b74a7ae115efb02b3897c89233a8d49d7 WatchSource:0}: Error finding container 351a03e47f3d4073e93407e2cc58d05b74a7ae115efb02b3897c89233a8d49d7: Status 404 returned error can't find the container with id 351a03e47f3d4073e93407e2cc58d05b74a7ae115efb02b3897c89233a8d49d7 Jun 03 15:49:06.470735 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:06.470699 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d547784_0771_4962_8bd6_3978f1f12270.slice/crio-64f4a61dae92d7d607b2d46bd15c27c58fa259d8f74bad3b4d7addb92d03f3ae WatchSource:0}: Error finding container 64f4a61dae92d7d607b2d46bd15c27c58fa259d8f74bad3b4d7addb92d03f3ae: Status 404 returned error can't find the container with id 64f4a61dae92d7d607b2d46bd15c27c58fa259d8f74bad3b4d7addb92d03f3ae Jun 03 15:49:06.472305 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:06.472253 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93574a4f_2ef5_4fdf_b043_22f427e422c3.slice/crio-63dde877aef359a2f4c397ab4a80e0dbe191f16d6d836d7293a5ded08f9d941a WatchSource:0}: Error finding container 63dde877aef359a2f4c397ab4a80e0dbe191f16d6d836d7293a5ded08f9d941a: Status 404 returned error can't find the container with id 63dde877aef359a2f4c397ab4a80e0dbe191f16d6d836d7293a5ded08f9d941a Jun 03 15:49:06.479830 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:06.479494 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce75af7_452d_4ffc_9116_2fe1a407343c.slice/crio-0619d9099d912488d9f04aec266fa10524abc7afb688aee6964db954946f95ff WatchSource:0}: Error finding container 0619d9099d912488d9f04aec266fa10524abc7afb688aee6964db954946f95ff: Status 404 returned error can't find the container with id 0619d9099d912488d9f04aec266fa10524abc7afb688aee6964db954946f95ff Jun 03 15:49:06.480731 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:06.480332 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22772c03_b3eb_4adc_9506_a2c893508a04.slice/crio-1ff1a40be75c9a4e34e75ef5fcd33b5350c2cf82c20d836285cd22ce06445113 WatchSource:0}: Error finding container 1ff1a40be75c9a4e34e75ef5fcd33b5350c2cf82c20d836285cd22ce06445113: Status 404 returned error can't find the container with id 1ff1a40be75c9a4e34e75ef5fcd33b5350c2cf82c20d836285cd22ce06445113 Jun 03 15:49:06.481915 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:06.481796 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06b5c81_587c_47ae_930a_981b833dca4e.slice/crio-ff49cdc1f06419fd8fad85779eb0ed0502da594daa6c9fe489df1df89950e46d WatchSource:0}: Error finding container ff49cdc1f06419fd8fad85779eb0ed0502da594daa6c9fe489df1df89950e46d: Status 404 returned error can't find the container with id ff49cdc1f06419fd8fad85779eb0ed0502da594daa6c9fe489df1df89950e46d Jun 03 15:49:06.520948 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.520798 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:06.521050 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.520910 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:06.521089 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.521080 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs podName:b4ed3727-e0a3-4df1-91e4-cdaa043a854f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:07.52106311 +0000 UTC m=+4.116822782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs") pod "network-metrics-daemon-5t5zt" (UID: "b4ed3727-e0a3-4df1-91e4-cdaa043a854f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:06.621305 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.621275 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:06.621474 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.621407 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:06.621474 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.621429 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:06.621474 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.621441 2582 projected.go:194] Error preparing data for projected volume kube-api-access-nbfxk for pod openshift-network-diagnostics/network-check-target-s89rk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:06.621604 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:06.621494 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk podName:7f30f556-2f07-43d5-8577-8c9d8129efd8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:07.621480721 +0000 UTC m=+4.217240393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbfxk" (UniqueName: "kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk") pod "network-check-target-s89rk" (UID: "7f30f556-2f07-43d5-8577-8c9d8129efd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:06.938516 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.938468 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:44:04 +0000 UTC" deadline="2028-01-19 08:32:34.559534297 +0000 UTC" Jun 03 15:49:06.938516 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:06.938513 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14272h43m27.621024717s" Jun 03 15:49:07.052019 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.051075 2582 generic.go:358] "Generic (PLEG): container finished" podID="af853be8510a56e46e69663383e34ba0" containerID="224fed60c13b472485df80b596181a80334376388dc3924fe897b5f3d30e0450" exitCode=0 Jun 03 15:49:07.052019 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.051155 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" event={"ID":"af853be8510a56e46e69663383e34ba0","Type":"ContainerDied","Data":"224fed60c13b472485df80b596181a80334376388dc3924fe897b5f3d30e0450"} Jun 03 15:49:07.071123 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.071077 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" event={"ID":"bf6fe2708a04c0590747b24b7dfe25f1","Type":"ContainerStarted","Data":"1e457384f2214e8304deb8cfb8fbd699c5327071ecea22f2e59476ad3b7a48bb"} Jun 03 15:49:07.086277 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.086224 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lp5s5" event={"ID":"a06b5c81-587c-47ae-930a-981b833dca4e","Type":"ContainerStarted","Data":"ff49cdc1f06419fd8fad85779eb0ed0502da594daa6c9fe489df1df89950e46d"} Jun 03 15:49:07.102586 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.102547 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5gdd" event={"ID":"22772c03-b3eb-4adc-9506-a2c893508a04","Type":"ContainerStarted","Data":"1ff1a40be75c9a4e34e75ef5fcd33b5350c2cf82c20d836285cd22ce06445113"} Jun 03 15:49:07.107457 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.107422 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nz2nn" event={"ID":"3b8787a4-9a3d-4633-815d-8bfea72d7d11","Type":"ContainerStarted","Data":"66ef6f7bef6dc37a3c2316445cdf886abad5d90ddc703922f0b32400714aca6b"} Jun 03 15:49:07.109841 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.109813 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerStarted","Data":"b59fe2e775f86d86a6f8f0a9c0771468785c7b29556ab99a652f1567d8bf29c0"} Jun 03 15:49:07.117089 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.117064 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"63dde877aef359a2f4c397ab4a80e0dbe191f16d6d836d7293a5ded08f9d941a"} Jun 03 15:49:07.119739 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.119634 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q24c4" event={"ID":"162dba91-9a68-4519-8600-44268d7e92cb","Type":"ContainerStarted","Data":"12e29a1d79e7b81a3cdbb5c1f7e322ddeabbed12959cb6c7c26b71df36e910c0"} Jun 03 15:49:07.139661 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.139430 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" event={"ID":"1ce75af7-452d-4ffc-9116-2fe1a407343c","Type":"ContainerStarted","Data":"0619d9099d912488d9f04aec266fa10524abc7afb688aee6964db954946f95ff"} Jun 03 15:49:07.159997 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.159959 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hvzs4" event={"ID":"4d547784-0771-4962-8bd6-3978f1f12270","Type":"ContainerStarted","Data":"64f4a61dae92d7d607b2d46bd15c27c58fa259d8f74bad3b4d7addb92d03f3ae"} Jun 03 15:49:07.180463 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.180412 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-knn7w" event={"ID":"4d3cb6c4-597f-46bf-8647-da28719643fc","Type":"ContainerStarted","Data":"351a03e47f3d4073e93407e2cc58d05b74a7ae115efb02b3897c89233a8d49d7"} Jun 03 15:49:07.530632 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.529994 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:07.530632 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:07.530200 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:07.530632 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:07.530283 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs podName:b4ed3727-e0a3-4df1-91e4-cdaa043a854f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:09.53024258 +0000 UTC m=+6.126002254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs") pod "network-metrics-daemon-5t5zt" (UID: "b4ed3727-e0a3-4df1-91e4-cdaa043a854f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:07.632662 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:07.631927 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:07.632662 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:07.632113 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:07.632662 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:07.632136 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:07.632662 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:07.632149 2582 projected.go:194] Error preparing data for projected volume kube-api-access-nbfxk for pod openshift-network-diagnostics/network-check-target-s89rk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:07.632662 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:07.632210 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk podName:7f30f556-2f07-43d5-8577-8c9d8129efd8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:09.632189402 +0000 UTC m=+6.227949074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbfxk" (UniqueName: "kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk") pod "network-check-target-s89rk" (UID: "7f30f556-2f07-43d5-8577-8c9d8129efd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:08.031562 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:08.031464 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:08.032012 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:08.031687 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:08.032209 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:08.032185 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:08.032328 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:08.032305 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:08.214065 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:08.214025 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" event={"ID":"af853be8510a56e46e69663383e34ba0","Type":"ContainerStarted","Data":"2ea2006773da3afacf4d81c608be4ba1d84515cab87b0d3a04f1191b899a7acf"} Jun 03 15:49:08.236065 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:08.236004 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-72.ec2.internal" podStartSLOduration=3.235983777 podStartE2EDuration="3.235983777s" podCreationTimestamp="2026-06-03 15:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:07.089678905 +0000 UTC m=+3.685438601" watchObservedRunningTime="2026-06-03 15:49:08.235983777 +0000 UTC m=+4.831743471" Jun 03 15:49:09.547572 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:09.547533 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:09.548126 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:09.547702 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:09.548126 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:09.547781 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs podName:b4ed3727-e0a3-4df1-91e4-cdaa043a854f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:13.547759779 +0000 UTC m=+10.143519466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs") pod "network-metrics-daemon-5t5zt" (UID: "b4ed3727-e0a3-4df1-91e4-cdaa043a854f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:09.649065 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:09.649025 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:09.649220 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:09.649193 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:09.649220 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:09.649220 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:09.649351 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:09.649235 2582 projected.go:194] Error preparing data for projected volume kube-api-access-nbfxk for pod openshift-network-diagnostics/network-check-target-s89rk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:09.649452 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:09.649432 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk podName:7f30f556-2f07-43d5-8577-8c9d8129efd8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:13.649407332 +0000 UTC m=+10.245167018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbfxk" (UniqueName: "kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk") pod "network-check-target-s89rk" (UID: "7f30f556-2f07-43d5-8577-8c9d8129efd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:10.032083 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:10.032019 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:10.032211 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:10.032125 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:10.032400 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:10.032376 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:10.032547 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:10.032479 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:12.033140 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:12.033108 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:12.033594 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:12.033239 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:12.033692 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:12.033666 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:12.033818 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:12.033757 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:13.585547 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:13.585508 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:13.585963 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:13.585691 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:13.585963 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:13.585756 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs podName:b4ed3727-e0a3-4df1-91e4-cdaa043a854f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:21.585736495 +0000 UTC m=+18.181496172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs") pod "network-metrics-daemon-5t5zt" (UID: "b4ed3727-e0a3-4df1-91e4-cdaa043a854f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:13.686851 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:13.686810 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:13.687024 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:13.686986 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:13.687024 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:13.687003 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:13.687024 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:13.687013 2582 projected.go:194] Error preparing data for projected volume kube-api-access-nbfxk for pod openshift-network-diagnostics/network-check-target-s89rk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:13.687190 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:13.687072 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk podName:7f30f556-2f07-43d5-8577-8c9d8129efd8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:21.687054213 +0000 UTC m=+18.282813905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbfxk" (UniqueName: "kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk") pod "network-check-target-s89rk" (UID: "7f30f556-2f07-43d5-8577-8c9d8129efd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:14.033104 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:14.033020 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:14.033240 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:14.033136 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:14.033240 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:14.033208 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:14.033352 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:14.033297 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:16.031022 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:16.030990 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:16.031397 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:16.030990 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:16.031397 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:16.031103 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:16.031397 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:16.031163 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:18.031086 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:18.031044 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:18.031086 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:18.031078 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:18.031625 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:18.031191 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:18.031625 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:18.031303 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:20.030846 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:20.030811 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:20.031373 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:20.030807 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:20.031373 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:20.030955 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:20.031373 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:20.031071 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:21.647167 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:21.647122 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:21.647578 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:21.647277 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:21.647578 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:21.647336 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs podName:b4ed3727-e0a3-4df1-91e4-cdaa043a854f nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.647321977 +0000 UTC m=+34.243081655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs") pod "network-metrics-daemon-5t5zt" (UID: "b4ed3727-e0a3-4df1-91e4-cdaa043a854f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:21.748069 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:21.747939 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:21.748141 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:21.748066 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:21.748141 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:21.748089 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:21.748141 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:21.748101 2582 projected.go:194] Error preparing data for projected volume kube-api-access-nbfxk for pod openshift-network-diagnostics/network-check-target-s89rk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:21.748307 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:21.748164 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk podName:7f30f556-2f07-43d5-8577-8c9d8129efd8 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:37.748144901 +0000 UTC m=+34.343904574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbfxk" (UniqueName: "kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk") pod "network-check-target-s89rk" (UID: "7f30f556-2f07-43d5-8577-8c9d8129efd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:22.030401 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:22.030365 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:22.030546 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:22.030365 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:22.030546 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:22.030478 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:22.030546 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:22.030536 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:24.031035 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:24.030995 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:24.031487 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:24.031107 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:24.031487 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:24.031146 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:24.031487 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:24.031225 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:26.031029 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.030725 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:26.031652 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.030757 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:26.031652 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:26.031118 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:26.031652 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:26.031221 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:26.244738 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.244664 2582 generic.go:358] "Generic (PLEG): container finished" podID="ca4f5810-9958-46a9-8967-129c6517bf3f" containerID="678864ee5d22fca0548dd821aa784fd0e79fc4a97f065234fff77cb10a912b3b" exitCode=0 Jun 03 15:49:26.245030 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.244975 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerDied","Data":"678864ee5d22fca0548dd821aa784fd0e79fc4a97f065234fff77cb10a912b3b"} Jun 03 15:49:26.248575 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.248552 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"02bf340ef36075fc9694f99b038710638dbbeefb8ebc26d13ef130e5f6c24287"} Jun 03 15:49:26.248658 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.248581 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"2990782f88b701d1a727e3b8f8e64cbc62c154ea72c816fd345e6eaf759e8af8"} Jun 03 15:49:26.248658 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.248593 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"70698aae032ba611d91d8cfc00404865279fc0a242574fbacdd0a410cd44a2a0"} Jun 03 15:49:26.248658 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.248601 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"0bc21ac337baedabd678b7c2a40243882b3c42c49167d0bc479b67eebced9ceb"} Jun 03 15:49:26.248658 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.248609 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"dfc91ab2b7fc699ec443b9fa7e78190baa2522cb8bebe9b80511ac758d4d879b"} Jun 03 15:49:26.248658 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.248616 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"e3dd43f16782f6146eb20c6794e0bb6fec0e5bf658c112740c9e57d8ec079b89"} Jun 03 15:49:26.250205 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.250180 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q24c4" event={"ID":"162dba91-9a68-4519-8600-44268d7e92cb","Type":"ContainerStarted","Data":"99192dad7ff761ad5d6bbcb29e24f27633ebfc825f1abe9f7f667d14c527ecb8"} Jun 03 15:49:26.252280 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.252241 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" event={"ID":"1ce75af7-452d-4ffc-9116-2fe1a407343c","Type":"ContainerStarted","Data":"a863ac160ebcf945cdf016740b4776850f4f285db997e919188767880a484b4a"} Jun 03 15:49:26.253703 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.253674 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hvzs4" event={"ID":"4d547784-0771-4962-8bd6-3978f1f12270","Type":"ContainerStarted","Data":"e11df83875e36bb6347d12854def888aaf1044b6f4fa50f0673690e7cac1790c"} Jun 03 15:49:26.255448 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.255423 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-knn7w" event={"ID":"4d3cb6c4-597f-46bf-8647-da28719643fc","Type":"ContainerStarted","Data":"600387fa1cad17a4b80f470cffbf4b555c4288e141b6fe021a0fab819399b866"} Jun 03 15:49:26.256764 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.256744 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5gdd" event={"ID":"22772c03-b3eb-4adc-9506-a2c893508a04","Type":"ContainerStarted","Data":"5639d11d1d701848f3646463b5a0cdf74c1cec2f10c8a8abf69b1cc985218c31"} Jun 03 15:49:26.258012 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.257981 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nz2nn" event={"ID":"3b8787a4-9a3d-4633-815d-8bfea72d7d11","Type":"ContainerStarted","Data":"87a10ae1d27a10fd28dc28eb9a1aa029f3424904b1b90f650f208304addcc5c4"} Jun 03 15:49:26.287895 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.287842 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-72.ec2.internal" podStartSLOduration=22.287823133 podStartE2EDuration="22.287823133s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:49:08.236443401 +0000 UTC m=+4.832203095" watchObservedRunningTime="2026-06-03 15:49:26.287823133 +0000 UTC m=+22.883582830" Jun 03 15:49:26.419610 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.419549 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nz2nn" podStartSLOduration=3.423871606 podStartE2EDuration="22.419530713s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.480216083 +0000 UTC m=+3.075975761" lastFinishedPulling="2026-06-03 15:49:25.475875194 +0000 UTC m=+22.071634868" observedRunningTime="2026-06-03 15:49:26.419460967 +0000 UTC m=+23.015220661" watchObservedRunningTime="2026-06-03 15:49:26.419530713 +0000 UTC m=+23.015290409" Jun 03 15:49:26.419789 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.419655 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hvzs4" podStartSLOduration=3.470237396 podStartE2EDuration="22.419647864s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.473223392 +0000 UTC m=+3.068983066" lastFinishedPulling="2026-06-03 15:49:25.422633863 +0000 UTC m=+22.018393534" observedRunningTime="2026-06-03 15:49:26.337921926 +0000 UTC m=+22.933681619" watchObservedRunningTime="2026-06-03 15:49:26.419647864 +0000 UTC m=+23.015407559" Jun 03 15:49:26.468390 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.468350 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j5gdd" podStartSLOduration=7.40490579 podStartE2EDuration="22.468334989s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.484288053 +0000 UTC m=+3.080047726" lastFinishedPulling="2026-06-03 15:49:21.547717238 +0000 UTC m=+18.143476925" observedRunningTime="2026-06-03 15:49:26.460718827 +0000 UTC m=+23.056478522" watchObservedRunningTime="2026-06-03 15:49:26.468334989 +0000 UTC m=+23.064094683" Jun 03 15:49:26.509130 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.509088 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-knn7w" podStartSLOduration=3.5084697350000003 podStartE2EDuration="22.509073019s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.471771207 +0000 UTC m=+3.067530879" lastFinishedPulling="2026-06-03 15:49:25.472374476 +0000 UTC m=+22.068134163" observedRunningTime="2026-06-03 15:49:26.509023789 +0000 UTC m=+23.104783482" watchObservedRunningTime="2026-06-03 15:49:26.509073019 +0000 UTC m=+23.104832712" Jun 03 15:49:26.556037 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.555986 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-q24c4" podStartSLOduration=3.232537941 podStartE2EDuration="22.555967408s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.478322283 +0000 UTC m=+3.074081970" lastFinishedPulling="2026-06-03 15:49:25.801751765 +0000 UTC m=+22.397511437" observedRunningTime="2026-06-03 15:49:26.555569963 +0000 UTC m=+23.151329658" watchObservedRunningTime="2026-06-03 15:49:26.555967408 +0000 UTC m=+23.151727102" Jun 03 15:49:26.757172 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.757135 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:26.757783 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:26.757767 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:27.046940 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.046903 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:49:27.260622 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.260583 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lp5s5" event={"ID":"a06b5c81-587c-47ae-930a-981b833dca4e","Type":"ContainerStarted","Data":"30abc3c76200c4b816a6cd1bad5862288b6dc7da0177dd962b4d4376e51a12a6"} Jun 03 15:49:27.262144 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.262122 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" event={"ID":"1ce75af7-452d-4ffc-9116-2fe1a407343c","Type":"ContainerStarted","Data":"a3d3fce6c7f3ccad60f284e6b5450fe6054b5a16f897a0b206a8e42c98e9bbd9"} Jun 03 15:49:27.262795 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.262773 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:27.262896 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.262879 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j5gdd" Jun 03 15:49:27.356094 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.356003 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lp5s5" podStartSLOduration=4.38054164 podStartE2EDuration="23.355985641s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.485877065 +0000 UTC m=+3.081636747" lastFinishedPulling="2026-06-03 15:49:25.461321076 +0000 UTC m=+22.057080748" observedRunningTime="2026-06-03 15:49:27.319683355 +0000 UTC m=+23.915443048" watchObservedRunningTime="2026-06-03 15:49:27.355985641 +0000 UTC m=+23.951745318" Jun 03 15:49:27.398192 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:27.398150 2582 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64: Manifest does not match provided manifest digest sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64" Jun 03 15:49:27.398390 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:27.398308 2582 kuberuntime_manager.go:1358] "Unhandled Error" err="init container &Container{Name:cni-plugins,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64,Command:[/bin/bash -c /entrypoint/cnibincopy.sh && cp -n /sysctls/allowlist.conf /host/etc/cni/tuning/],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:RHEL8_SOURCE_DIRECTORY,Value:/usr/src/plugins/rhel8/bin/,ValueFrom:nil,},EnvVar{Name:RHEL9_SOURCE_DIRECTORY,Value:/usr/src/plugins/rhel9/bin/,ValueFrom:nil,},EnvVar{Name:DEFAULT_SOURCE_DIRECTORY,Value:/usr/src/plugins/bin/,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-binary-copy,ReadOnly:false,MountPath:/entrypoint,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:cnibin,ReadOnly:false,MountPath:/host/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:os-release,ReadOnly:true,MountPath:/host/etc/os-release,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tuning-conf-dir,ReadOnly:false,MountPath:/host/etc/cni/tuning/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:cni-sysctl-allowlist,ReadOnly:false,MountPath:/sysctls,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-vptsq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod multus-additional-cni-plugins-2l9nk_openshift-multus(ca4f5810-9958-46a9-8967-129c6517bf3f): ErrImagePull: unable to pull image or OCI artifact: pull image err: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64: Manifest does not match provided manifest digest sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64; artifact err: provided artifact is a container image" logger="UnhandledError" Jun 03 15:49:27.399494 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:27.399464 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cni-plugins\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64: Manifest does not match provided manifest digest sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64; artifact err: provided artifact is a container image\"" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" podUID="ca4f5810-9958-46a9-8967-129c6517bf3f" Jun 03 15:49:27.964641 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.964545 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:49:27.046934774Z","UUID":"826bc6b6-8892-4d40-83cd-c9e1bdf95cdd","Handler":null,"Name":"","Endpoint":""} Jun 03 15:49:27.966469 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.966434 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:49:27.966469 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:27.966462 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:49:28.030962 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:28.030934 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:28.031112 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:28.030936 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:28.031112 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:28.031046 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:28.031194 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:28.031125 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:28.265208 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:28.265176 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" event={"ID":"1ce75af7-452d-4ffc-9116-2fe1a407343c","Type":"ContainerStarted","Data":"a68869944a6d878430ea2bb358a4dbdde61c92f89b17ef49b9a0ba7e006b3ece"} Jun 03 15:49:28.267176 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:28.267153 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cni-plugins\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64: Manifest does not match provided manifest digest sha256:008c234802c8e7dcaa8ef96c78ade1464cc8855bc9354e54c8064d2824407d64; artifact err: provided artifact is a container image\"" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" podUID="ca4f5810-9958-46a9-8967-129c6517bf3f" Jun 03 15:49:28.338937 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:28.338733 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqh6n" podStartSLOduration=2.714844082 podStartE2EDuration="24.338717563s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.482437569 +0000 UTC m=+3.078197243" lastFinishedPulling="2026-06-03 15:49:28.106311048 +0000 UTC m=+24.702070724" observedRunningTime="2026-06-03 15:49:28.338517473 +0000 UTC m=+24.934277166" watchObservedRunningTime="2026-06-03 15:49:28.338717563 +0000 UTC m=+24.934477257" Jun 03 15:49:29.270068 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:29.270029 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"1a06a1d55cb7cbb89cd38d0df70b890729884127f9b22164d03fdfb33fa6e748"} Jun 03 15:49:30.030813 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:30.030775 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:30.030988 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:30.030850 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:30.030988 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:30.030956 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:30.031104 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:30.031078 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:31.276327 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:31.276126 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" event={"ID":"93574a4f-2ef5-4fdf-b043-22f427e422c3","Type":"ContainerStarted","Data":"faba473f18d2beb95f86246dcc50b3c6850d46273b1a6617d8d650aa07a8205c"} Jun 03 15:49:31.277104 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:31.276482 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:31.277104 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:31.276503 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:31.277104 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:31.276511 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:31.292811 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:31.292789 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:31.293172 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:31.293157 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:49:31.324795 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:31.324751 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" podStartSLOduration=8.296286611 podStartE2EDuration="27.324738513s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.474844603 +0000 UTC m=+3.070604275" lastFinishedPulling="2026-06-03 15:49:25.503296492 +0000 UTC m=+22.099056177" observedRunningTime="2026-06-03 15:49:31.324599914 +0000 UTC m=+27.920359608" watchObservedRunningTime="2026-06-03 15:49:31.324738513 +0000 UTC m=+27.920498207" Jun 03 15:49:32.030514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:32.030478 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:32.030694 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:32.030517 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:32.030694 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:32.030618 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:32.030796 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:32.030747 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:32.721075 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:32.721043 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s89rk"] Jun 03 15:49:32.721499 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:32.721147 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:32.721499 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:32.721366 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:32.724621 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:32.724548 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5t5zt"] Jun 03 15:49:32.724753 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:32.724694 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:32.724854 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:32.724829 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:34.031226 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:34.031191 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:34.031641 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:34.031238 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:34.031641 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:34.031309 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:34.031641 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:34.031415 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:36.030376 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:36.030344 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:36.030754 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:36.030460 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:36.030754 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:36.030534 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:36.030754 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:36.030570 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:37.666905 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:37.666864 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:37.667405 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:37.666987 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:37.667405 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:37.667064 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs podName:b4ed3727-e0a3-4df1-91e4-cdaa043a854f nodeName:}" failed. No retries permitted until 2026-06-03 15:50:09.667041307 +0000 UTC m=+66.262800982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs") pod "network-metrics-daemon-5t5zt" (UID: "b4ed3727-e0a3-4df1-91e4-cdaa043a854f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:49:37.767952 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:37.767912 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:37.768106 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:37.768089 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:49:37.768144 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:37.768112 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:49:37.768144 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:37.768123 2582 projected.go:194] Error preparing data for projected volume kube-api-access-nbfxk for pod openshift-network-diagnostics/network-check-target-s89rk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:37.768217 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:37.768173 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk podName:7f30f556-2f07-43d5-8577-8c9d8129efd8 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:09.768159403 +0000 UTC m=+66.363919079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nbfxk" (UniqueName: "kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk") pod "network-check-target-s89rk" (UID: "7f30f556-2f07-43d5-8577-8c9d8129efd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:49:38.030050 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.030016 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:38.030214 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.030017 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:38.030214 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:38.030172 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t5zt" podUID="b4ed3727-e0a3-4df1-91e4-cdaa043a854f" Jun 03 15:49:38.030347 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:38.030225 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s89rk" podUID="7f30f556-2f07-43d5-8577-8c9d8129efd8" Jun 03 15:49:38.740320 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.740294 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-72.ec2.internal" event="NodeReady" Jun 03 15:49:38.740758 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.740440 2582 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:49:38.802245 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.802212 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7dvm8"] Jun 03 15:49:38.882375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.882339 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bslbg"] Jun 03 15:49:38.882554 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.882504 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:38.886918 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.886897 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:49:38.887157 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.887142 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5tk8p\"" Jun 03 15:49:38.887222 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.887171 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:49:38.898430 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.898410 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7dvm8"] Jun 03 15:49:38.898430 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.898433 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bslbg"] Jun 03 15:49:38.898553 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.898513 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:38.902616 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.902597 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:49:38.902709 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.902632 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:49:38.903319 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.903299 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fs7s\"" Jun 03 15:49:38.903398 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.903330 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:49:38.975312 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.975275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-config-volume\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:38.975312 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.975314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:38.975531 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.975331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-tmp-dir\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:38.975531 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:38.975351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mntb\" (UniqueName: \"kubernetes.io/projected/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-kube-api-access-4mntb\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.075721 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.075644 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z42n\" (UniqueName: \"kubernetes.io/projected/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-kube-api-access-8z42n\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:39.075721 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.075716 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-config-volume\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.075938 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.075756 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.075938 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.075786 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-tmp-dir\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.075938 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.075838 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mntb\" (UniqueName: \"kubernetes.io/projected/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-kube-api-access-4mntb\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.075938 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.075857 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:39.075938 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.075862 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:39.075938 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.075924 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls podName:7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:39.575904596 +0000 UTC m=+36.171664287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls") pod "dns-default-7dvm8" (UID: "7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6") : secret "dns-default-metrics-tls" not found Jun 03 15:49:39.076218 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.076146 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-tmp-dir\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.076218 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.076192 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-config-volume\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.105888 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.105850 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mntb\" (UniqueName: \"kubernetes.io/projected/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-kube-api-access-4mntb\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.176367 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.176328 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:39.176367 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.176373 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8z42n\" (UniqueName: \"kubernetes.io/projected/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-kube-api-access-8z42n\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:39.176616 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.176481 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:39.176616 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.176542 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert podName:ff491c49-1d2d-4208-9aab-1a5a4c1626d1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:39.67652672 +0000 UTC m=+36.272286392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert") pod "ingress-canary-bslbg" (UID: "ff491c49-1d2d-4208-9aab-1a5a4c1626d1") : secret "canary-serving-cert" not found Jun 03 15:49:39.203517 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.203490 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z42n\" (UniqueName: \"kubernetes.io/projected/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-kube-api-access-8z42n\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:39.579957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.579921 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:39.580190 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.580089 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:39.580190 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.580157 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls podName:7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:40.580142372 +0000 UTC m=+37.175902048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls") pod "dns-default-7dvm8" (UID: "7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6") : secret "dns-default-metrics-tls" not found Jun 03 15:49:39.680365 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:39.680333 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:39.680494 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.680436 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:39.680494 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:39.680494 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert podName:ff491c49-1d2d-4208-9aab-1a5a4c1626d1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:40.680480725 +0000 UTC m=+37.276240397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert") pod "ingress-canary-bslbg" (UID: "ff491c49-1d2d-4208-9aab-1a5a4c1626d1") : secret "canary-serving-cert" not found Jun 03 15:49:40.031024 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.030986 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:49:40.031503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.031000 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:49:40.034995 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.034776 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:49:40.035106 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.035050 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:49:40.035331 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.035312 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:49:40.036734 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.036606 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhwds\"" Jun 03 15:49:40.036843 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.036743 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlwk\"" Jun 03 15:49:40.587929 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.587887 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:40.588129 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:40.588099 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:40.588198 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:40.588164 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls podName:7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:42.588146503 +0000 UTC m=+39.183906183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls") pod "dns-default-7dvm8" (UID: "7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6") : secret "dns-default-metrics-tls" not found Jun 03 15:49:40.688671 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:40.688631 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:40.688837 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:40.688782 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:40.688876 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:40.688862 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert podName:ff491c49-1d2d-4208-9aab-1a5a4c1626d1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:42.688844657 +0000 UTC m=+39.284604333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert") pod "ingress-canary-bslbg" (UID: "ff491c49-1d2d-4208-9aab-1a5a4c1626d1") : secret "canary-serving-cert" not found Jun 03 15:49:42.603905 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:42.603857 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:42.604363 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:42.603987 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:42.604363 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:42.604038 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls podName:7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:46.604024065 +0000 UTC m=+43.199783737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls") pod "dns-default-7dvm8" (UID: "7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6") : secret "dns-default-metrics-tls" not found Jun 03 15:49:42.704668 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:42.704632 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:42.704831 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:42.704777 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:42.704886 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:42.704853 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert podName:ff491c49-1d2d-4208-9aab-1a5a4c1626d1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:46.704832675 +0000 UTC m=+43.300592363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert") pod "ingress-canary-bslbg" (UID: "ff491c49-1d2d-4208-9aab-1a5a4c1626d1") : secret "canary-serving-cert" not found Jun 03 15:49:46.306452 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:46.306357 2582 generic.go:358] "Generic (PLEG): container finished" podID="ca4f5810-9958-46a9-8967-129c6517bf3f" containerID="282487a9cadba0dea20f4ce8960d19093c464ab928ea9319fae2e4a794e16468" exitCode=0 Jun 03 15:49:46.306452 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:46.306417 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerDied","Data":"282487a9cadba0dea20f4ce8960d19093c464ab928ea9319fae2e4a794e16468"} Jun 03 15:49:46.632754 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:46.632669 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:46.632898 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:46.632809 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:46.632898 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:46.632873 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls podName:7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:54.632857783 +0000 UTC m=+51.228617455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls") pod "dns-default-7dvm8" (UID: "7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6") : secret "dns-default-metrics-tls" not found Jun 03 15:49:46.733549 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:46.733510 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:46.733763 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:46.733664 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:46.733763 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:46.733731 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert podName:ff491c49-1d2d-4208-9aab-1a5a4c1626d1 nodeName:}" failed. No retries permitted until 2026-06-03 15:49:54.733715451 +0000 UTC m=+51.329475128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert") pod "ingress-canary-bslbg" (UID: "ff491c49-1d2d-4208-9aab-1a5a4c1626d1") : secret "canary-serving-cert" not found Jun 03 15:49:48.311846 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:48.311812 2582 generic.go:358] "Generic (PLEG): container finished" podID="ca4f5810-9958-46a9-8967-129c6517bf3f" containerID="1fffa389b3bec488b9a5e5c5eeca15163d03794bdb6e0fd44a317efc8f061370" exitCode=0 Jun 03 15:49:48.312217 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:48.311874 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerDied","Data":"1fffa389b3bec488b9a5e5c5eeca15163d03794bdb6e0fd44a317efc8f061370"} Jun 03 15:49:50.318229 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:50.318191 2582 generic.go:358] "Generic (PLEG): container finished" podID="ca4f5810-9958-46a9-8967-129c6517bf3f" containerID="b32563682a5bd857a3c25b3c1c0f37f9bb55bd47fe184c6d676840b3d8e81597" exitCode=0 Jun 03 15:49:50.318706 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:50.318274 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerDied","Data":"b32563682a5bd857a3c25b3c1c0f37f9bb55bd47fe184c6d676840b3d8e81597"} Jun 03 15:49:51.183164 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.183121 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg"] Jun 03 15:49:51.198463 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.198434 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" Jun 03 15:49:51.201530 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.201501 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 15:49:51.202864 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.202842 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 15:49:51.202990 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.202860 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mswtt\"" Jun 03 15:49:51.219932 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.219906 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg"] Jun 03 15:49:51.265076 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.265050 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5b44\" (UniqueName: \"kubernetes.io/projected/8a1e414e-881d-443d-87f4-36029711ade6-kube-api-access-f5b44\") pod \"migrator-96c6f749-x47qg\" (UID: \"8a1e414e-881d-443d-87f4-36029711ade6\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" Jun 03 15:49:51.365406 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.365374 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5b44\" (UniqueName: \"kubernetes.io/projected/8a1e414e-881d-443d-87f4-36029711ade6-kube-api-access-f5b44\") pod \"migrator-96c6f749-x47qg\" (UID: \"8a1e414e-881d-443d-87f4-36029711ade6\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" Jun 03 15:49:51.376278 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.376241 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5b44\" (UniqueName: \"kubernetes.io/projected/8a1e414e-881d-443d-87f4-36029711ade6-kube-api-access-f5b44\") pod \"migrator-96c6f749-x47qg\" (UID: \"8a1e414e-881d-443d-87f4-36029711ade6\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" Jun 03 15:49:51.508859 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.508812 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" Jun 03 15:49:51.684379 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:51.684334 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg"] Jun 03 15:49:51.688032 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:51.688000 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1e414e_881d_443d_87f4_36029711ade6.slice/crio-a7e999be81239c382d93f247c32a63db0add5c1b50c3369f8a2e5d7dc92f30f6 WatchSource:0}: Error finding container a7e999be81239c382d93f247c32a63db0add5c1b50c3369f8a2e5d7dc92f30f6: Status 404 returned error can't find the container with id a7e999be81239c382d93f247c32a63db0add5c1b50c3369f8a2e5d7dc92f30f6 Jun 03 15:49:52.322923 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:52.322885 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" event={"ID":"8a1e414e-881d-443d-87f4-36029711ade6","Type":"ContainerStarted","Data":"a7e999be81239c382d93f247c32a63db0add5c1b50c3369f8a2e5d7dc92f30f6"} Jun 03 15:49:53.615699 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.615669 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-npkpv"] Jun 03 15:49:53.630228 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.630173 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.634839 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.634817 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 15:49:53.635039 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.635013 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 15:49:53.635118 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.635058 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 15:49:53.635767 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.635577 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 15:49:53.638480 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.638338 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-27m9f\"" Jun 03 15:49:53.640043 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.640018 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-npkpv"] Jun 03 15:49:53.681750 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.681715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28nd6\" (UniqueName: \"kubernetes.io/projected/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-kube-api-access-28nd6\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.681899 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.681767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-signing-key\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.681899 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.681884 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-signing-cabundle\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.782739 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.782702 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28nd6\" (UniqueName: \"kubernetes.io/projected/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-kube-api-access-28nd6\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.782739 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.782747 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-signing-key\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.782927 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.782800 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-signing-cabundle\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.783540 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.783522 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-signing-cabundle\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.785319 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.785301 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-signing-key\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.794140 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.794119 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28nd6\" (UniqueName: \"kubernetes.io/projected/29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b-kube-api-access-28nd6\") pod \"service-ca-685df94d57-npkpv\" (UID: \"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b\") " pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:53.941792 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:53.941700 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-npkpv" Jun 03 15:49:54.116571 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:54.116535 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-npkpv"] Jun 03 15:49:54.119848 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:49:54.119819 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c7d8db_9a2c_4f06_a8a5_f6d4c393ae9b.slice/crio-18c98ab9bfd15dba6ae5b5ce063b8e35ae8abe2b32d28004fa8687b8d6e0a69b WatchSource:0}: Error finding container 18c98ab9bfd15dba6ae5b5ce063b8e35ae8abe2b32d28004fa8687b8d6e0a69b: Status 404 returned error can't find the container with id 18c98ab9bfd15dba6ae5b5ce063b8e35ae8abe2b32d28004fa8687b8d6e0a69b Jun 03 15:49:54.131874 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:54.131854 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nz2nn_3b8787a4-9a3d-4633-815d-8bfea72d7d11/dns-node-resolver/0.log" Jun 03 15:49:54.329172 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:54.328671 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" event={"ID":"8a1e414e-881d-443d-87f4-36029711ade6","Type":"ContainerStarted","Data":"050859a60cdb1e6138f9180291821ad542fda7e16462bbb49df8cc337caedaac"} Jun 03 15:49:54.329172 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:54.328710 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" event={"ID":"8a1e414e-881d-443d-87f4-36029711ade6","Type":"ContainerStarted","Data":"4e08ab4f9d000f2e8ec2c74e2e61cff72d875e57724ef6a3ccfd175bd5f7c325"} Jun 03 15:49:54.329841 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:54.329818 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-npkpv" event={"ID":"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b","Type":"ContainerStarted","Data":"18c98ab9bfd15dba6ae5b5ce063b8e35ae8abe2b32d28004fa8687b8d6e0a69b"} Jun 03 15:49:54.691076 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:54.690995 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:49:54.691494 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:54.691174 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:49:54.691494 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:54.691286 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls podName:7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:10.691249756 +0000 UTC m=+67.287009445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls") pod "dns-default-7dvm8" (UID: "7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6") : secret "dns-default-metrics-tls" not found Jun 03 15:49:54.792422 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:54.791802 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:49:54.792422 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:54.792008 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:49:54.792422 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:49:54.792075 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert podName:ff491c49-1d2d-4208-9aab-1a5a4c1626d1 nodeName:}" failed. No retries permitted until 2026-06-03 15:50:10.792055818 +0000 UTC m=+67.387815506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert") pod "ingress-canary-bslbg" (UID: "ff491c49-1d2d-4208-9aab-1a5a4c1626d1") : secret "canary-serving-cert" not found Jun 03 15:49:55.321302 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:55.321254 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hvzs4_4d547784-0771-4962-8bd6-3978f1f12270/node-ca/0.log" Jun 03 15:49:56.521929 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:56.521896 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-x47qg_8a1e414e-881d-443d-87f4-36029711ade6/migrator/0.log" Jun 03 15:49:56.720745 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:56.720719 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-x47qg_8a1e414e-881d-443d-87f4-36029711ade6/graceful-termination/0.log" Jun 03 15:49:58.340476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:58.340381 2582 generic.go:358] "Generic (PLEG): container finished" podID="ca4f5810-9958-46a9-8967-129c6517bf3f" containerID="1ebfb1dfbfd0ea9db7cc497efa75b04e835d72ecead30e90325d85d02e16cff0" exitCode=0 Jun 03 15:49:58.340476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:58.340426 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerDied","Data":"1ebfb1dfbfd0ea9db7cc497efa75b04e835d72ecead30e90325d85d02e16cff0"} Jun 03 15:49:58.341888 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:58.341862 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-npkpv" event={"ID":"29c7d8db-9a2c-4f06-a8a5-f6d4c393ae9b","Type":"ContainerStarted","Data":"e5163edff5e91530ac32779798c58d08616ab8d7e2eac35949a5fcecdd64093a"} Jun 03 15:49:58.367999 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:58.367958 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x47qg" podStartSLOduration=5.6854699570000005 podStartE2EDuration="7.367942103s" podCreationTimestamp="2026-06-03 15:49:51 +0000 UTC" firstStartedPulling="2026-06-03 15:49:51.690229436 +0000 UTC m=+48.285989123" lastFinishedPulling="2026-06-03 15:49:53.372701595 +0000 UTC m=+49.968461269" observedRunningTime="2026-06-03 15:49:54.354688757 +0000 UTC m=+50.950448451" watchObservedRunningTime="2026-06-03 15:49:58.367942103 +0000 UTC m=+54.963701800" Jun 03 15:49:58.389366 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:58.389322 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-npkpv" podStartSLOduration=1.524752009 podStartE2EDuration="5.389304593s" podCreationTimestamp="2026-06-03 15:49:53 +0000 UTC" firstStartedPulling="2026-06-03 15:49:54.121863831 +0000 UTC m=+50.717623503" lastFinishedPulling="2026-06-03 15:49:57.986416409 +0000 UTC m=+54.582176087" observedRunningTime="2026-06-03 15:49:58.388921851 +0000 UTC m=+54.984681545" watchObservedRunningTime="2026-06-03 15:49:58.389304593 +0000 UTC m=+54.985064290" Jun 03 15:49:59.347001 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:59.346962 2582 generic.go:358] "Generic (PLEG): container finished" podID="ca4f5810-9958-46a9-8967-129c6517bf3f" containerID="c3c1e32cd896a6451b00f2e3d6c9826f32300f6d61d53b1e74d8e53ee7fbbea9" exitCode=0 Jun 03 15:49:59.347479 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:49:59.347029 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerDied","Data":"c3c1e32cd896a6451b00f2e3d6c9826f32300f6d61d53b1e74d8e53ee7fbbea9"} Jun 03 15:50:00.351966 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:00.351929 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" event={"ID":"ca4f5810-9958-46a9-8967-129c6517bf3f","Type":"ContainerStarted","Data":"238ef5a377c724b96e28610344a40720126338a4a62f711b5b554e0877929236"} Jun 03 15:50:00.381408 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:00.381358 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2l9nk" podStartSLOduration=4.857223845 podStartE2EDuration="56.381343006s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:49:06.477884652 +0000 UTC m=+3.073644334" lastFinishedPulling="2026-06-03 15:49:58.002003809 +0000 UTC m=+54.597763495" observedRunningTime="2026-06-03 15:50:00.379168947 +0000 UTC m=+56.974928641" watchObservedRunningTime="2026-06-03 15:50:00.381343006 +0000 UTC m=+56.977102726" Jun 03 15:50:03.290619 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:03.290589 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxr7" Jun 03 15:50:09.702628 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.702577 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:50:09.706071 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.706052 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:50:09.715400 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.715349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ed3727-e0a3-4df1-91e4-cdaa043a854f-metrics-certs\") pod \"network-metrics-daemon-5t5zt\" (UID: \"b4ed3727-e0a3-4df1-91e4-cdaa043a854f\") " pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:50:09.752321 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.752294 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qlwk\"" Jun 03 15:50:09.760102 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.760077 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t5zt" Jun 03 15:50:09.803746 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.803707 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:50:09.807382 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.807306 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:50:09.817730 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.817703 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:50:09.827096 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.827068 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbfxk\" (UniqueName: \"kubernetes.io/projected/7f30f556-2f07-43d5-8577-8c9d8129efd8-kube-api-access-nbfxk\") pod \"network-check-target-s89rk\" (UID: \"7f30f556-2f07-43d5-8577-8c9d8129efd8\") " pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:50:09.895729 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:09.895692 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5t5zt"] Jun 03 15:50:09.899534 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:09.899501 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ed3727_e0a3_4df1_91e4_cdaa043a854f.slice/crio-edd5f6cd553791a31c849844f034a047633b4b8745224f48e4dc55c187066bde WatchSource:0}: Error finding container edd5f6cd553791a31c849844f034a047633b4b8745224f48e4dc55c187066bde: Status 404 returned error can't find the container with id edd5f6cd553791a31c849844f034a047633b4b8745224f48e4dc55c187066bde Jun 03 15:50:10.047425 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.047393 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nhwds\"" Jun 03 15:50:10.054891 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.054870 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:50:10.183166 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.183133 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s89rk"] Jun 03 15:50:10.185624 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:10.185598 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f30f556_2f07_43d5_8577_8c9d8129efd8.slice/crio-670bd9098f95b1e6b7b075ef41c964fc5fab982284a1a415598e0050efdc91b8 WatchSource:0}: Error finding container 670bd9098f95b1e6b7b075ef41c964fc5fab982284a1a415598e0050efdc91b8: Status 404 returned error can't find the container with id 670bd9098f95b1e6b7b075ef41c964fc5fab982284a1a415598e0050efdc91b8 Jun 03 15:50:10.373211 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.373123 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s89rk" event={"ID":"7f30f556-2f07-43d5-8577-8c9d8129efd8","Type":"ContainerStarted","Data":"670bd9098f95b1e6b7b075ef41c964fc5fab982284a1a415598e0050efdc91b8"} Jun 03 15:50:10.374369 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.374330 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t5zt" event={"ID":"b4ed3727-e0a3-4df1-91e4-cdaa043a854f","Type":"ContainerStarted","Data":"edd5f6cd553791a31c849844f034a047633b4b8745224f48e4dc55c187066bde"} Jun 03 15:50:10.711401 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.711321 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:50:10.713878 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.713855 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6-metrics-tls\") pod \"dns-default-7dvm8\" (UID: \"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6\") " pod="openshift-dns/dns-default-7dvm8" Jun 03 15:50:10.812155 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.812104 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:50:10.817915 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:10.817886 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff491c49-1d2d-4208-9aab-1a5a4c1626d1-cert\") pod \"ingress-canary-bslbg\" (UID: \"ff491c49-1d2d-4208-9aab-1a5a4c1626d1\") " pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:50:11.002203 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.002172 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5tk8p\"" Jun 03 15:50:11.004293 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.004254 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7dvm8" Jun 03 15:50:11.011746 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.011725 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fs7s\"" Jun 03 15:50:11.017126 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.017104 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bslbg" Jun 03 15:50:11.186613 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.186583 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7dvm8"] Jun 03 15:50:11.191384 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:11.191353 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0a2b74_0ff3_45c9_9f1c_a40c2f0526a6.slice/crio-16e8ebcf6a2e73799559f785c5d17b032cdf17431a2dedaca93cc0bcbde0e70c WatchSource:0}: Error finding container 16e8ebcf6a2e73799559f785c5d17b032cdf17431a2dedaca93cc0bcbde0e70c: Status 404 returned error can't find the container with id 16e8ebcf6a2e73799559f785c5d17b032cdf17431a2dedaca93cc0bcbde0e70c Jun 03 15:50:11.193599 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.193453 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bslbg"] Jun 03 15:50:11.199094 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:11.199061 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff491c49_1d2d_4208_9aab_1a5a4c1626d1.slice/crio-0173d50717032a6f368bc3db712dcab56ad3b0c9eaf0d3fad6af68ec6a485411 WatchSource:0}: Error finding container 0173d50717032a6f368bc3db712dcab56ad3b0c9eaf0d3fad6af68ec6a485411: Status 404 returned error can't find the container with id 0173d50717032a6f368bc3db712dcab56ad3b0c9eaf0d3fad6af68ec6a485411 Jun 03 15:50:11.378411 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.378370 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7dvm8" event={"ID":"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6","Type":"ContainerStarted","Data":"16e8ebcf6a2e73799559f785c5d17b032cdf17431a2dedaca93cc0bcbde0e70c"} Jun 03 15:50:11.380242 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.380211 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t5zt" event={"ID":"b4ed3727-e0a3-4df1-91e4-cdaa043a854f","Type":"ContainerStarted","Data":"6ffcd9efa66755b87af82989000103b221b0d03dab416bbf64f4d69ba8c99eb3"} Jun 03 15:50:11.380378 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.380251 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t5zt" event={"ID":"b4ed3727-e0a3-4df1-91e4-cdaa043a854f","Type":"ContainerStarted","Data":"90846fbb8fe0878617a32ca20740d79350d68f2f0a556709d0e9e50b39cc0fe6"} Jun 03 15:50:11.381299 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.381255 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bslbg" event={"ID":"ff491c49-1d2d-4208-9aab-1a5a4c1626d1","Type":"ContainerStarted","Data":"0173d50717032a6f368bc3db712dcab56ad3b0c9eaf0d3fad6af68ec6a485411"} Jun 03 15:50:11.409973 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:11.409926 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5t5zt" podStartSLOduration=66.254239955 podStartE2EDuration="1m7.409910054s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:50:09.901453974 +0000 UTC m=+66.497213646" lastFinishedPulling="2026-06-03 15:50:11.05712407 +0000 UTC m=+67.652883745" observedRunningTime="2026-06-03 15:50:11.408554648 +0000 UTC m=+68.004314343" watchObservedRunningTime="2026-06-03 15:50:11.409910054 +0000 UTC m=+68.005669748" Jun 03 15:50:14.391381 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.391341 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7dvm8" event={"ID":"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6","Type":"ContainerStarted","Data":"956c7f5a1f06e8576c65aed658f57cf681591107c575c070fb611ba4f13b956f"} Jun 03 15:50:14.391381 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.391382 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7dvm8" event={"ID":"7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6","Type":"ContainerStarted","Data":"6eb86520229687e0e8009c932c55a27bc18916ef9a56a87534b64932af161227"} Jun 03 15:50:14.391885 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.391483 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7dvm8" Jun 03 15:50:14.392603 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.392580 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bslbg" event={"ID":"ff491c49-1d2d-4208-9aab-1a5a4c1626d1","Type":"ContainerStarted","Data":"a7d11fa39537df5ccaf056bc3617467c7dd0ef2d002f63bf810bd17d98e75864"} Jun 03 15:50:14.393828 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.393806 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s89rk" event={"ID":"7f30f556-2f07-43d5-8577-8c9d8129efd8","Type":"ContainerStarted","Data":"f992a57c9e0a95bfae51cf850d88bc3b69b8dc66164787c7bd734e894d3a91ce"} Jun 03 15:50:14.393965 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.393950 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:50:14.430555 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.430511 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7dvm8" podStartSLOduration=33.681404494 podStartE2EDuration="36.430499305s" podCreationTimestamp="2026-06-03 15:49:38 +0000 UTC" firstStartedPulling="2026-06-03 15:50:11.196939074 +0000 UTC m=+67.792698758" lastFinishedPulling="2026-06-03 15:50:13.946033883 +0000 UTC m=+70.541793569" observedRunningTime="2026-06-03 15:50:14.430331934 +0000 UTC m=+71.026091627" watchObservedRunningTime="2026-06-03 15:50:14.430499305 +0000 UTC m=+71.026258978" Jun 03 15:50:14.456731 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.456686 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bslbg" podStartSLOduration=33.708995965 podStartE2EDuration="36.456674314s" podCreationTimestamp="2026-06-03 15:49:38 +0000 UTC" firstStartedPulling="2026-06-03 15:50:11.201384694 +0000 UTC m=+67.797144366" lastFinishedPulling="2026-06-03 15:50:13.949063039 +0000 UTC m=+70.544822715" observedRunningTime="2026-06-03 15:50:14.456450094 +0000 UTC m=+71.052209787" watchObservedRunningTime="2026-06-03 15:50:14.456674314 +0000 UTC m=+71.052434007" Jun 03 15:50:14.480689 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:14.480642 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s89rk" podStartSLOduration=66.723380122 podStartE2EDuration="1m10.480627668s" podCreationTimestamp="2026-06-03 15:49:04 +0000 UTC" firstStartedPulling="2026-06-03 15:50:10.187449923 +0000 UTC m=+66.783209595" lastFinishedPulling="2026-06-03 15:50:13.944697451 +0000 UTC m=+70.540457141" observedRunningTime="2026-06-03 15:50:14.480018908 +0000 UTC m=+71.075778604" watchObservedRunningTime="2026-06-03 15:50:14.480627668 +0000 UTC m=+71.076387398" Jun 03 15:50:17.523907 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.523875 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jtkwt"] Jun 03 15:50:17.525804 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.525789 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.529830 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.529803 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:50:17.533188 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.533141 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:50:17.546920 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.546894 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:50:17.547066 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.546895 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:50:17.547066 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.546993 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5dkg\"" Jun 03 15:50:17.548002 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.547966 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jtkwt"] Jun 03 15:50:17.558119 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.558098 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f704e019-f289-4909-b76e-092c23f4bdd3-data-volume\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.558214 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.558133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f704e019-f289-4909-b76e-092c23f4bdd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.558214 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.558155 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7czx\" (UniqueName: \"kubernetes.io/projected/f704e019-f289-4909-b76e-092c23f4bdd3-kube-api-access-f7czx\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.558214 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.558172 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f704e019-f289-4909-b76e-092c23f4bdd3-crio-socket\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.558214 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.558190 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f704e019-f289-4909-b76e-092c23f4bdd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.658524 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.658479 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f704e019-f289-4909-b76e-092c23f4bdd3-crio-socket\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.658524 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.658523 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f704e019-f289-4909-b76e-092c23f4bdd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.658734 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.658617 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f704e019-f289-4909-b76e-092c23f4bdd3-crio-socket\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.658734 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.658653 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f704e019-f289-4909-b76e-092c23f4bdd3-data-volume\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.658734 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.658696 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f704e019-f289-4909-b76e-092c23f4bdd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.658734 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.658727 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7czx\" (UniqueName: \"kubernetes.io/projected/f704e019-f289-4909-b76e-092c23f4bdd3-kube-api-access-f7czx\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.658990 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.658974 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f704e019-f289-4909-b76e-092c23f4bdd3-data-volume\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.659241 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.659222 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f704e019-f289-4909-b76e-092c23f4bdd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.661046 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.661029 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f704e019-f289-4909-b76e-092c23f4bdd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.682245 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.682222 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7czx\" (UniqueName: \"kubernetes.io/projected/f704e019-f289-4909-b76e-092c23f4bdd3-kube-api-access-f7czx\") pod \"insights-runtime-extractor-jtkwt\" (UID: \"f704e019-f289-4909-b76e-092c23f4bdd3\") " pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.835749 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.835674 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jtkwt" Jun 03 15:50:17.993017 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:17.992985 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jtkwt"] Jun 03 15:50:17.995081 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:17.995048 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf704e019_f289_4909_b76e_092c23f4bdd3.slice/crio-4f503ae032585dee2ea3d436c47bf5d7c861bd5c1afe013a859852ca000b62a6 WatchSource:0}: Error finding container 4f503ae032585dee2ea3d436c47bf5d7c861bd5c1afe013a859852ca000b62a6: Status 404 returned error can't find the container with id 4f503ae032585dee2ea3d436c47bf5d7c861bd5c1afe013a859852ca000b62a6 Jun 03 15:50:18.405943 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:18.405865 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtkwt" event={"ID":"f704e019-f289-4909-b76e-092c23f4bdd3","Type":"ContainerStarted","Data":"baed5e847034a71077d7e4cbce7472fd753497a77a4022057dba0e7ed14edb69"} Jun 03 15:50:18.405943 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:18.405906 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtkwt" event={"ID":"f704e019-f289-4909-b76e-092c23f4bdd3","Type":"ContainerStarted","Data":"4f503ae032585dee2ea3d436c47bf5d7c861bd5c1afe013a859852ca000b62a6"} Jun 03 15:50:19.411028 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:19.410986 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtkwt" event={"ID":"f704e019-f289-4909-b76e-092c23f4bdd3","Type":"ContainerStarted","Data":"e649409dddb6aa577759b15d00647981101ef6916243b951ae6bb42a0dd73d29"} Jun 03 15:50:22.423465 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:22.423421 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtkwt" event={"ID":"f704e019-f289-4909-b76e-092c23f4bdd3","Type":"ContainerStarted","Data":"13b5884f4f6fedcc2ad4a16334f42003906a120ef2503e66dafacf6346296a5d"} Jun 03 15:50:22.450919 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:22.450863 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jtkwt" podStartSLOduration=2.227787507 podStartE2EDuration="5.450847208s" podCreationTimestamp="2026-06-03 15:50:17 +0000 UTC" firstStartedPulling="2026-06-03 15:50:18.134668077 +0000 UTC m=+74.730427749" lastFinishedPulling="2026-06-03 15:50:21.357727774 +0000 UTC m=+77.953487450" observedRunningTime="2026-06-03 15:50:22.449016528 +0000 UTC m=+79.044776224" watchObservedRunningTime="2026-06-03 15:50:22.450847208 +0000 UTC m=+79.046606901" Jun 03 15:50:24.397726 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:24.397694 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7dvm8" Jun 03 15:50:40.381675 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.381635 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh"] Jun 03 15:50:40.384795 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.384776 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" Jun 03 15:50:40.389129 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.389101 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xhh2b\"" Jun 03 15:50:40.389129 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.389105 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 15:50:40.403539 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.403511 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh"] Jun 03 15:50:40.504457 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.504413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ac386a72-085f-4ce2-8246-ea4569f49800-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zfxvh\" (UID: \"ac386a72-085f-4ce2-8246-ea4569f49800\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" Jun 03 15:50:40.605506 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.605466 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ac386a72-085f-4ce2-8246-ea4569f49800-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zfxvh\" (UID: \"ac386a72-085f-4ce2-8246-ea4569f49800\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" Jun 03 15:50:40.608002 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.607979 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ac386a72-085f-4ce2-8246-ea4569f49800-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zfxvh\" (UID: \"ac386a72-085f-4ce2-8246-ea4569f49800\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" Jun 03 15:50:40.693065 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.692983 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" Jun 03 15:50:40.825169 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:40.825131 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh"] Jun 03 15:50:40.828884 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:40.828857 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac386a72_085f_4ce2_8246_ea4569f49800.slice/crio-701c3939d76a226da7ec101402c0262a39d79cfdd8a67122063e9e59a0a5f4fa WatchSource:0}: Error finding container 701c3939d76a226da7ec101402c0262a39d79cfdd8a67122063e9e59a0a5f4fa: Status 404 returned error can't find the container with id 701c3939d76a226da7ec101402c0262a39d79cfdd8a67122063e9e59a0a5f4fa Jun 03 15:50:41.473527 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:41.473482 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" event={"ID":"ac386a72-085f-4ce2-8246-ea4569f49800","Type":"ContainerStarted","Data":"701c3939d76a226da7ec101402c0262a39d79cfdd8a67122063e9e59a0a5f4fa"} Jun 03 15:50:42.476891 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:42.476853 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" event={"ID":"ac386a72-085f-4ce2-8246-ea4569f49800","Type":"ContainerStarted","Data":"5becdf312cd744c1d4acf7c5c59e6c8f4f6787663abd3007cf5bcba1bdd2ae48"} Jun 03 15:50:42.477390 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:42.477080 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" Jun 03 15:50:42.481831 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:42.481810 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" Jun 03 15:50:42.503867 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:42.503813 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zfxvh" podStartSLOduration=1.459439618 podStartE2EDuration="2.50379902s" podCreationTimestamp="2026-06-03 15:50:40 +0000 UTC" firstStartedPulling="2026-06-03 15:50:40.83074637 +0000 UTC m=+97.426506042" lastFinishedPulling="2026-06-03 15:50:41.87510577 +0000 UTC m=+98.470865444" observedRunningTime="2026-06-03 15:50:42.502058216 +0000 UTC m=+99.097817911" watchObservedRunningTime="2026-06-03 15:50:42.50379902 +0000 UTC m=+99.099558749" Jun 03 15:50:43.453660 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.453621 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9"] Jun 03 15:50:43.455620 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.455603 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.460157 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.460128 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 15:50:43.460388 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.460365 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 15:50:43.460530 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.460386 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:50:43.460596 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.460548 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:50:43.462029 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.461956 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:50:43.462165 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.462042 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-s6spp\"" Jun 03 15:50:43.468999 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.468980 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9"] Jun 03 15:50:43.529060 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.529027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn2qf\" (UniqueName: \"kubernetes.io/projected/a1cd56cb-ccb2-46cd-97dd-b46248d33078-kube-api-access-mn2qf\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.529060 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.529070 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1cd56cb-ccb2-46cd-97dd-b46248d33078-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.529494 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.529116 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1cd56cb-ccb2-46cd-97dd-b46248d33078-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.529494 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.529166 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1cd56cb-ccb2-46cd-97dd-b46248d33078-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.630023 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.629991 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1cd56cb-ccb2-46cd-97dd-b46248d33078-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.630023 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.630028 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2qf\" (UniqueName: \"kubernetes.io/projected/a1cd56cb-ccb2-46cd-97dd-b46248d33078-kube-api-access-mn2qf\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.630293 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.630056 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1cd56cb-ccb2-46cd-97dd-b46248d33078-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.630293 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.630090 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1cd56cb-ccb2-46cd-97dd-b46248d33078-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.630692 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.630660 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1cd56cb-ccb2-46cd-97dd-b46248d33078-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.632639 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.632617 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1cd56cb-ccb2-46cd-97dd-b46248d33078-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.632727 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.632690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1cd56cb-ccb2-46cd-97dd-b46248d33078-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.640832 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.640811 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2qf\" (UniqueName: \"kubernetes.io/projected/a1cd56cb-ccb2-46cd-97dd-b46248d33078-kube-api-access-mn2qf\") pod \"prometheus-operator-658bcd8bdf-dj5v9\" (UID: \"a1cd56cb-ccb2-46cd-97dd-b46248d33078\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.766094 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.766057 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" Jun 03 15:50:43.908597 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:43.908529 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9"] Jun 03 15:50:43.910601 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:43.910574 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1cd56cb_ccb2_46cd_97dd_b46248d33078.slice/crio-ff30121c45e56ed005cda41eebbf7d16c34d580379ea682995ec3b5cea42b694 WatchSource:0}: Error finding container ff30121c45e56ed005cda41eebbf7d16c34d580379ea682995ec3b5cea42b694: Status 404 returned error can't find the container with id ff30121c45e56ed005cda41eebbf7d16c34d580379ea682995ec3b5cea42b694 Jun 03 15:50:44.482242 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:44.482202 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" event={"ID":"a1cd56cb-ccb2-46cd-97dd-b46248d33078","Type":"ContainerStarted","Data":"ff30121c45e56ed005cda41eebbf7d16c34d580379ea682995ec3b5cea42b694"} Jun 03 15:50:45.398726 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:45.398692 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s89rk" Jun 03 15:50:46.489442 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:46.489402 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" event={"ID":"a1cd56cb-ccb2-46cd-97dd-b46248d33078","Type":"ContainerStarted","Data":"e13f133522ccbd1f9f2a8d9508acb39e0660aa8d4dc477d83644ed2c9e40bf55"} Jun 03 15:50:46.489442 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:46.489447 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" event={"ID":"a1cd56cb-ccb2-46cd-97dd-b46248d33078","Type":"ContainerStarted","Data":"8c2db7ceee2e463729488a04345c8cd00fd7d79e3f0bbeb2495fac56d1862315"} Jun 03 15:50:46.511549 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:46.511504 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dj5v9" podStartSLOduration=1.702314591 podStartE2EDuration="3.511490725s" podCreationTimestamp="2026-06-03 15:50:43 +0000 UTC" firstStartedPulling="2026-06-03 15:50:43.912456769 +0000 UTC m=+100.508216441" lastFinishedPulling="2026-06-03 15:50:45.721632903 +0000 UTC m=+102.317392575" observedRunningTime="2026-06-03 15:50:46.511036183 +0000 UTC m=+103.106795882" watchObservedRunningTime="2026-06-03 15:50:46.511490725 +0000 UTC m=+103.107250419" Jun 03 15:50:48.914832 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.914794 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-xgttk"] Jun 03 15:50:48.917355 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.917338 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:48.920478 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.920446 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:50:48.920597 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.920563 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 15:50:48.921742 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.921724 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zjvxh\"" Jun 03 15:50:48.930818 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.930798 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-xgttk"] Jun 03 15:50:48.963322 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.963291 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s62n4"] Jun 03 15:50:48.965644 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.965624 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:48.966076 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.966056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:48.966174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.966102 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:48.966238 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.966213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:48.966314 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.966278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sb2m\" (UniqueName: \"kubernetes.io/projected/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-kube-api-access-4sb2m\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:48.968930 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.968910 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:50:48.969085 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.969061 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:50:48.969197 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.968912 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:50:48.969347 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:48.969332 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-66bjq\"" Jun 03 15:50:49.066617 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066579 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-metrics-client-ca\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.066814 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066633 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sb2m\" (UniqueName: \"kubernetes.io/projected/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-kube-api-access-4sb2m\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.066814 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-textfile\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.066814 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066728 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.066814 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgcvp\" (UniqueName: \"kubernetes.io/projected/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-kube-api-access-vgcvp\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.066814 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-root\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.067067 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066856 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.067067 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:50:49.066943 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 15:50:49.067067 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.066937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-sys\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.067067 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:50:49.067004 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-tls podName:f19d54e8-e1bb-4f34-baaf-bcbb175cad1c nodeName:}" failed. No retries permitted until 2026-06-03 15:50:49.566983818 +0000 UTC m=+106.162743492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-xgttk" (UID: "f19d54e8-e1bb-4f34-baaf-bcbb175cad1c") : secret "openshift-state-metrics-tls" not found Jun 03 15:50:49.067067 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.067032 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.067323 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.067087 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-wtmp\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.067323 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.067134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.067323 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.067167 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.067323 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.067184 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-tls\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.067749 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.067731 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.069417 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.069394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.085329 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.085254 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sb2m\" (UniqueName: \"kubernetes.io/projected/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-kube-api-access-4sb2m\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.168432 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168350 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-textfile\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168432 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168405 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgcvp\" (UniqueName: \"kubernetes.io/projected/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-kube-api-access-vgcvp\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168432 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168421 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-root\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168457 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-sys\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168473 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168503 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-wtmp\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168521 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168545 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-tls\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168566 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-sys\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168584 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-root\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.168687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168572 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-metrics-client-ca\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.169055 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168687 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-wtmp\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.169055 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.168755 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-textfile\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.169136 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.169121 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-metrics-client-ca\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.169170 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.169141 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.170993 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.170971 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.171085 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.171063 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-node-exporter-tls\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.179170 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.179148 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgcvp\" (UniqueName: \"kubernetes.io/projected/d4433791-8d1d-4c6c-a8b9-1b34f832dccd-kube-api-access-vgcvp\") pod \"node-exporter-s62n4\" (UID: \"d4433791-8d1d-4c6c-a8b9-1b34f832dccd\") " pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.279281 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.279216 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s62n4" Jun 03 15:50:49.287887 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:49.287859 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4433791_8d1d_4c6c_a8b9_1b34f832dccd.slice/crio-f02c5d97f3f5c897c0da7c493817cf0d479f0a46144151712453d9a0b9959704 WatchSource:0}: Error finding container f02c5d97f3f5c897c0da7c493817cf0d479f0a46144151712453d9a0b9959704: Status 404 returned error can't find the container with id f02c5d97f3f5c897c0da7c493817cf0d479f0a46144151712453d9a0b9959704 Jun 03 15:50:49.498098 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.498067 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s62n4" event={"ID":"d4433791-8d1d-4c6c-a8b9-1b34f832dccd","Type":"ContainerStarted","Data":"f02c5d97f3f5c897c0da7c493817cf0d479f0a46144151712453d9a0b9959704"} Jun 03 15:50:49.570892 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.570850 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.573410 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.573385 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f19d54e8-e1bb-4f34-baaf-bcbb175cad1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-xgttk\" (UID: \"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.827518 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.827448 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" Jun 03 15:50:49.994470 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:49.994433 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-xgttk"] Jun 03 15:50:49.998674 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:49.998642 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19d54e8_e1bb_4f34_baaf_bcbb175cad1c.slice/crio-70a6948bcd6866ccfe3e17eb0918cfab64c0955110137d1afb4760a0598053b3 WatchSource:0}: Error finding container 70a6948bcd6866ccfe3e17eb0918cfab64c0955110137d1afb4760a0598053b3: Status 404 returned error can't find the container with id 70a6948bcd6866ccfe3e17eb0918cfab64c0955110137d1afb4760a0598053b3 Jun 03 15:50:50.502573 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.502534 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" event={"ID":"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c","Type":"ContainerStarted","Data":"baaef3505b8711b0159dda5d1830c13d875619ebcda61d9f55b972b640d126c9"} Jun 03 15:50:50.502732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.502580 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" event={"ID":"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c","Type":"ContainerStarted","Data":"30688aeed2ce5655eb65de04ca8229bb7887fac64a60059a25dc4ea8881675ca"} Jun 03 15:50:50.502732 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.502592 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" event={"ID":"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c","Type":"ContainerStarted","Data":"70a6948bcd6866ccfe3e17eb0918cfab64c0955110137d1afb4760a0598053b3"} Jun 03 15:50:50.504093 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.504059 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s62n4" event={"ID":"d4433791-8d1d-4c6c-a8b9-1b34f832dccd","Type":"ContainerStarted","Data":"5d5812ca66c2587709c85fa450acda7b1b25fdb5ee99f0a0c19fad751b9930b0"} Jun 03 15:50:50.900273 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.900221 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85c9444cff-vw7wb"] Jun 03 15:50:50.903077 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.903053 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.906214 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.906178 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 15:50:50.906340 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.906329 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dbl5dmohuu9j1\"" Jun 03 15:50:50.906413 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.906179 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 15:50:50.906562 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.906543 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 15:50:50.906620 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.906548 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 15:50:50.906620 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.906591 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6dw59\"" Jun 03 15:50:50.906735 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.906671 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 15:50:50.915400 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.915370 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85c9444cff-vw7wb"] Jun 03 15:50:50.982608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982576 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-grpc-tls\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.982782 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982628 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvcq4\" (UniqueName: \"kubernetes.io/projected/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-kube-api-access-mvcq4\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.982782 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982661 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-tls\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.982782 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.982782 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982722 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.982782 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.982993 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982798 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-metrics-client-ca\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:50.982993 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:50.982830 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.083398 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083363 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvcq4\" (UniqueName: \"kubernetes.io/projected/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-kube-api-access-mvcq4\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.083863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083413 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-tls\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.083863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083468 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.083863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083488 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.083863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083513 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.083863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083542 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-metrics-client-ca\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.084133 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083930 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.084133 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.083990 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-grpc-tls\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.084613 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.084553 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-metrics-client-ca\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.087206 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.086939 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.087206 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.086938 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.087206 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.087083 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-tls\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.087206 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.087164 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.087505 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.087226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.088520 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.088496 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-secret-grpc-tls\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.094636 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.094617 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvcq4\" (UniqueName: \"kubernetes.io/projected/f47fe03a-cce0-4dd3-bb77-a9c608108dc5-kube-api-access-mvcq4\") pod \"thanos-querier-85c9444cff-vw7wb\" (UID: \"f47fe03a-cce0-4dd3-bb77-a9c608108dc5\") " pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.214889 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.214805 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:51.380596 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.380570 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85c9444cff-vw7wb"] Jun 03 15:50:51.382654 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:51.382623 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47fe03a_cce0_4dd3_bb77_a9c608108dc5.slice/crio-6f10397680f65097795e56fd4ead100e09f4d17d0a2e3c3c1ec4f6a4fd35375b WatchSource:0}: Error finding container 6f10397680f65097795e56fd4ead100e09f4d17d0a2e3c3c1ec4f6a4fd35375b: Status 404 returned error can't find the container with id 6f10397680f65097795e56fd4ead100e09f4d17d0a2e3c3c1ec4f6a4fd35375b Jun 03 15:50:51.511569 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.511528 2582 generic.go:358] "Generic (PLEG): container finished" podID="d4433791-8d1d-4c6c-a8b9-1b34f832dccd" containerID="5d5812ca66c2587709c85fa450acda7b1b25fdb5ee99f0a0c19fad751b9930b0" exitCode=0 Jun 03 15:50:51.511757 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.511612 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s62n4" event={"ID":"d4433791-8d1d-4c6c-a8b9-1b34f832dccd","Type":"ContainerDied","Data":"5d5812ca66c2587709c85fa450acda7b1b25fdb5ee99f0a0c19fad751b9930b0"} Jun 03 15:50:51.513557 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.513533 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" event={"ID":"f19d54e8-e1bb-4f34-baaf-bcbb175cad1c","Type":"ContainerStarted","Data":"8317e63078f112ab49b8df93dc4c798a2361e5232b25870ab49455a4dbe1be45"} Jun 03 15:50:51.514539 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.514519 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" event={"ID":"f47fe03a-cce0-4dd3-bb77-a9c608108dc5","Type":"ContainerStarted","Data":"6f10397680f65097795e56fd4ead100e09f4d17d0a2e3c3c1ec4f6a4fd35375b"} Jun 03 15:50:51.557961 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:51.557920 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-xgttk" podStartSLOduration=2.456746364 podStartE2EDuration="3.557905787s" podCreationTimestamp="2026-06-03 15:50:48 +0000 UTC" firstStartedPulling="2026-06-03 15:50:50.155626438 +0000 UTC m=+106.751386109" lastFinishedPulling="2026-06-03 15:50:51.256785856 +0000 UTC m=+107.852545532" observedRunningTime="2026-06-03 15:50:51.557825233 +0000 UTC m=+108.153584931" watchObservedRunningTime="2026-06-03 15:50:51.557905787 +0000 UTC m=+108.153665480" Jun 03 15:50:52.519887 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:52.519845 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s62n4" event={"ID":"d4433791-8d1d-4c6c-a8b9-1b34f832dccd","Type":"ContainerStarted","Data":"3545d68018253f783c956a868ca4260d3c75de20286425f974f9bcdad684e5e1"} Jun 03 15:50:52.519887 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:52.519889 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s62n4" event={"ID":"d4433791-8d1d-4c6c-a8b9-1b34f832dccd","Type":"ContainerStarted","Data":"45b030e8bdef8a5f4f609b0f547d327279efc6cd66b63f5327189f8273de0a3f"} Jun 03 15:50:52.545590 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:52.545525 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s62n4" podStartSLOduration=3.462733659 podStartE2EDuration="4.545510823s" podCreationTimestamp="2026-06-03 15:50:48 +0000 UTC" firstStartedPulling="2026-06-03 15:50:49.290207055 +0000 UTC m=+105.885966727" lastFinishedPulling="2026-06-03 15:50:50.372984217 +0000 UTC m=+106.968743891" observedRunningTime="2026-06-03 15:50:52.544116429 +0000 UTC m=+109.139876125" watchObservedRunningTime="2026-06-03 15:50:52.545510823 +0000 UTC m=+109.141270616" Jun 03 15:50:53.985068 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:53.985035 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c474f85c4-8sb64"] Jun 03 15:50:54.042407 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.042375 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.046216 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.046191 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c474f85c4-8sb64"] Jun 03 15:50:54.046744 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.046723 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 15:50:54.046953 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.046933 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 15:50:54.047083 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.047059 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 15:50:54.047338 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.047321 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 15:50:54.048057 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.048031 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 15:50:54.048141 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.048066 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pdfbk\"" Jun 03 15:50:54.048141 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.048091 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 15:50:54.048141 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.048093 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 15:50:54.112146 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.112110 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-oauth-serving-cert\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.112146 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.112150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrz6v\" (UniqueName: \"kubernetes.io/projected/59ffa38b-6928-4a42-8791-b082c7c25007-kube-api-access-jrz6v\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.112354 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.112204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-oauth-config\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.112354 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.112222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-console-config\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.112354 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.112240 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-service-ca\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.112504 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.112358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-serving-cert\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.213365 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.213341 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-oauth-config\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.213495 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.213380 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-console-config\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.213495 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.213403 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-service-ca\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.213495 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.213439 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-serving-cert\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.213495 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.213491 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-oauth-serving-cert\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.213701 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.213537 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrz6v\" (UniqueName: \"kubernetes.io/projected/59ffa38b-6928-4a42-8791-b082c7c25007-kube-api-access-jrz6v\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.214194 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.214120 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-console-config\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.214194 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.214129 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-service-ca\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.214194 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.214179 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-oauth-serving-cert\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.215939 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.215920 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-serving-cert\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.216027 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.215938 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-oauth-config\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.229277 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.229231 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrz6v\" (UniqueName: \"kubernetes.io/projected/59ffa38b-6928-4a42-8791-b082c7c25007-kube-api-access-jrz6v\") pod \"console-6c474f85c4-8sb64\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.352948 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.352918 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:50:54.501796 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.501707 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c474f85c4-8sb64"] Jun 03 15:50:54.505871 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:50:54.505819 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ffa38b_6928_4a42_8791_b082c7c25007.slice/crio-78ed19f7f9a6c4cc6d4849a55703509dcf705eea79641bb35c91ae50da4d314f WatchSource:0}: Error finding container 78ed19f7f9a6c4cc6d4849a55703509dcf705eea79641bb35c91ae50da4d314f: Status 404 returned error can't find the container with id 78ed19f7f9a6c4cc6d4849a55703509dcf705eea79641bb35c91ae50da4d314f Jun 03 15:50:54.526806 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.526776 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" event={"ID":"f47fe03a-cce0-4dd3-bb77-a9c608108dc5","Type":"ContainerStarted","Data":"8a8c2bee7fb6455490286da563f133cdaad20a1929f39a0a490f46140221d4dc"} Jun 03 15:50:54.526899 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.526815 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" event={"ID":"f47fe03a-cce0-4dd3-bb77-a9c608108dc5","Type":"ContainerStarted","Data":"bfe39b5cbed787480f34531df18249b863b56e1867d392bd017b37f771a6239d"} Jun 03 15:50:54.526899 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.526825 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" event={"ID":"f47fe03a-cce0-4dd3-bb77-a9c608108dc5","Type":"ContainerStarted","Data":"0d22123157edd949713bcabaf5ebe6cc37bb44957e9555aeba6b343901d07070"} Jun 03 15:50:54.527687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:54.527661 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c474f85c4-8sb64" event={"ID":"59ffa38b-6928-4a42-8791-b082c7c25007","Type":"ContainerStarted","Data":"78ed19f7f9a6c4cc6d4849a55703509dcf705eea79641bb35c91ae50da4d314f"} Jun 03 15:50:55.534027 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:55.533988 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" event={"ID":"f47fe03a-cce0-4dd3-bb77-a9c608108dc5","Type":"ContainerStarted","Data":"5a48239bb7c4af3d69b821e1dc44830268b5a3056886fcdae44d3a562920ad12"} Jun 03 15:50:55.534452 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:55.534029 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" event={"ID":"f47fe03a-cce0-4dd3-bb77-a9c608108dc5","Type":"ContainerStarted","Data":"1313bd7d64369a73101b5bc4f6a34bd014b84aa4ebbffdf82f2ddfa23d031ab0"} Jun 03 15:50:55.534452 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:55.534047 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" event={"ID":"f47fe03a-cce0-4dd3-bb77-a9c608108dc5","Type":"ContainerStarted","Data":"ffae17435d8654aedec27713da2c3add23d8368dce0e77dfd476ec452d59147f"} Jun 03 15:50:55.534452 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:55.534229 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:50:55.563064 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:55.563004 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" podStartSLOduration=1.85330417 podStartE2EDuration="5.56298462s" podCreationTimestamp="2026-06-03 15:50:50 +0000 UTC" firstStartedPulling="2026-06-03 15:50:51.384425188 +0000 UTC m=+107.980184859" lastFinishedPulling="2026-06-03 15:50:55.094105637 +0000 UTC m=+111.689865309" observedRunningTime="2026-06-03 15:50:55.559935178 +0000 UTC m=+112.155694897" watchObservedRunningTime="2026-06-03 15:50:55.56298462 +0000 UTC m=+112.158744315" Jun 03 15:50:58.543932 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:58.543835 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c474f85c4-8sb64" event={"ID":"59ffa38b-6928-4a42-8791-b082c7c25007","Type":"ContainerStarted","Data":"24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf"} Jun 03 15:50:58.565957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:50:58.565907 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6c474f85c4-8sb64" podStartSLOduration=1.789004273 podStartE2EDuration="5.565892613s" podCreationTimestamp="2026-06-03 15:50:53 +0000 UTC" firstStartedPulling="2026-06-03 15:50:54.508742892 +0000 UTC m=+111.104502565" lastFinishedPulling="2026-06-03 15:50:58.285631232 +0000 UTC m=+114.881390905" observedRunningTime="2026-06-03 15:50:58.564978408 +0000 UTC m=+115.160738101" watchObservedRunningTime="2026-06-03 15:50:58.565892613 +0000 UTC m=+115.161652307" Jun 03 15:51:01.542818 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:01.542793 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85c9444cff-vw7wb" Jun 03 15:51:03.729931 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.729888 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6776664df6-h8kkb"] Jun 03 15:51:03.732164 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.732141 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.743218 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.743199 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 15:51:03.751627 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.751606 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6776664df6-h8kkb"] Jun 03 15:51:03.888735 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.888700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-serving-cert\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.888735 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.888738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-oauth-config\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.888950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.888759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7sjn\" (UniqueName: \"kubernetes.io/projected/690eaf4c-52f5-4a17-96d5-3c4348e4a174-kube-api-access-c7sjn\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.888950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.888820 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-trusted-ca-bundle\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.888950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.888857 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-config\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.888950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.888874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-service-ca\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.888950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.888908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-oauth-serving-cert\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990342 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990251 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-trusted-ca-bundle\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990342 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990300 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-config\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990342 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990318 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-service-ca\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990342 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990333 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-oauth-serving-cert\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990641 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990370 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-serving-cert\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990641 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990397 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-oauth-config\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990641 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990438 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7sjn\" (UniqueName: \"kubernetes.io/projected/690eaf4c-52f5-4a17-96d5-3c4348e4a174-kube-api-access-c7sjn\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.990996 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.990968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-config\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.991108 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.991021 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-oauth-serving-cert\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.991319 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.991204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-service-ca\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.992923 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.992904 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-oauth-config\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.993013 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.992974 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-serving-cert\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:03.999359 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:03.999335 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 15:51:04.001001 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.000983 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-trusted-ca-bundle\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:04.002121 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.002100 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7sjn\" (UniqueName: \"kubernetes.io/projected/690eaf4c-52f5-4a17-96d5-3c4348e4a174-kube-api-access-c7sjn\") pod \"console-6776664df6-h8kkb\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:04.041845 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.041815 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:04.167146 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.167123 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6776664df6-h8kkb"] Jun 03 15:51:04.169104 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:51:04.169073 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690eaf4c_52f5_4a17_96d5_3c4348e4a174.slice/crio-5e3b3d429ff7eb89584d4bf17ec89efa61aa5239e55548ca2078c0970383f900 WatchSource:0}: Error finding container 5e3b3d429ff7eb89584d4bf17ec89efa61aa5239e55548ca2078c0970383f900: Status 404 returned error can't find the container with id 5e3b3d429ff7eb89584d4bf17ec89efa61aa5239e55548ca2078c0970383f900 Jun 03 15:51:04.353780 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.353688 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:51:04.353780 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.353749 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:51:04.358174 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.358153 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:51:04.561350 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.561314 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776664df6-h8kkb" event={"ID":"690eaf4c-52f5-4a17-96d5-3c4348e4a174","Type":"ContainerStarted","Data":"dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090"} Jun 03 15:51:04.561350 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.561351 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776664df6-h8kkb" event={"ID":"690eaf4c-52f5-4a17-96d5-3c4348e4a174","Type":"ContainerStarted","Data":"5e3b3d429ff7eb89584d4bf17ec89efa61aa5239e55548ca2078c0970383f900"} Jun 03 15:51:04.565336 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.565310 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:51:04.583654 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:04.583612 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6776664df6-h8kkb" podStartSLOduration=1.583598951 podStartE2EDuration="1.583598951s" podCreationTimestamp="2026-06-03 15:51:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:51:04.582531418 +0000 UTC m=+121.178291112" watchObservedRunningTime="2026-06-03 15:51:04.583598951 +0000 UTC m=+121.179358644" Jun 03 15:51:14.042451 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:14.042421 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:14.043040 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:14.042463 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:14.046976 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:14.046954 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:14.594993 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:14.594964 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:51:14.653479 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:14.653438 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c474f85c4-8sb64"] Jun 03 15:51:15.124249 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:15.124223 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s62n4_d4433791-8d1d-4c6c-a8b9-1b34f832dccd/init-textfile/0.log" Jun 03 15:51:15.324184 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:15.324159 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s62n4_d4433791-8d1d-4c6c-a8b9-1b34f832dccd/node-exporter/0.log" Jun 03 15:51:15.524373 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:15.524349 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s62n4_d4433791-8d1d-4c6c-a8b9-1b34f832dccd/kube-rbac-proxy/0.log" Jun 03 15:51:15.722601 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:15.722569 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-xgttk_f19d54e8-e1bb-4f34-baaf-bcbb175cad1c/kube-rbac-proxy-main/0.log" Jun 03 15:51:15.923600 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:15.923526 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-xgttk_f19d54e8-e1bb-4f34-baaf-bcbb175cad1c/kube-rbac-proxy-self/0.log" Jun 03 15:51:16.123817 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:16.123788 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-xgttk_f19d54e8-e1bb-4f34-baaf-bcbb175cad1c/openshift-state-metrics/0.log" Jun 03 15:51:17.733892 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:17.733862 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dj5v9_a1cd56cb-ccb2-46cd-97dd-b46248d33078/prometheus-operator/0.log" Jun 03 15:51:17.923360 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:17.923327 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dj5v9_a1cd56cb-ccb2-46cd-97dd-b46248d33078/kube-rbac-proxy/0.log" Jun 03 15:51:18.126514 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:18.126435 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-zfxvh_ac386a72-085f-4ce2-8246-ea4569f49800/prometheus-operator-admission-webhook/0.log" Jun 03 15:51:18.323408 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:18.323379 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/thanos-query/0.log" Jun 03 15:51:18.523104 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:18.523077 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy-web/0.log" Jun 03 15:51:18.722784 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:18.722756 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy/0.log" Jun 03 15:51:18.923520 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:18.923437 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/prom-label-proxy/0.log" Jun 03 15:51:19.122761 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:19.122725 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy-rules/0.log" Jun 03 15:51:19.322989 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:19.322961 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy-metrics/0.log" Jun 03 15:51:20.125043 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:20.125010 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6776664df6-h8kkb_690eaf4c-52f5-4a17-96d5-3c4348e4a174/console/0.log" Jun 03 15:51:20.323181 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:20.323152 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c474f85c4-8sb64_59ffa38b-6928-4a42-8791-b082c7c25007/console/0.log" Jun 03 15:51:39.673466 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.673399 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6c474f85c4-8sb64" podUID="59ffa38b-6928-4a42-8791-b082c7c25007" containerName="console" containerID="cri-o://24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf" gracePeriod=15 Jun 03 15:51:39.909431 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.909411 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c474f85c4-8sb64_59ffa38b-6928-4a42-8791-b082c7c25007/console/0.log" Jun 03 15:51:39.909539 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.909478 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:51:39.961518 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961438 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-console-config\") pod \"59ffa38b-6928-4a42-8791-b082c7c25007\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " Jun 03 15:51:39.961518 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961488 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-oauth-serving-cert\") pod \"59ffa38b-6928-4a42-8791-b082c7c25007\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " Jun 03 15:51:39.961518 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961513 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrz6v\" (UniqueName: \"kubernetes.io/projected/59ffa38b-6928-4a42-8791-b082c7c25007-kube-api-access-jrz6v\") pod \"59ffa38b-6928-4a42-8791-b082c7c25007\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " Jun 03 15:51:39.961774 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961637 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-oauth-config\") pod \"59ffa38b-6928-4a42-8791-b082c7c25007\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " Jun 03 15:51:39.961774 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961691 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-service-ca\") pod \"59ffa38b-6928-4a42-8791-b082c7c25007\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " Jun 03 15:51:39.961774 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961718 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-serving-cert\") pod \"59ffa38b-6928-4a42-8791-b082c7c25007\" (UID: \"59ffa38b-6928-4a42-8791-b082c7c25007\") " Jun 03 15:51:39.961929 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961862 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59ffa38b-6928-4a42-8791-b082c7c25007" (UID: "59ffa38b-6928-4a42-8791-b082c7c25007"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:51:39.961929 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961871 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-console-config" (OuterVolumeSpecName: "console-config") pod "59ffa38b-6928-4a42-8791-b082c7c25007" (UID: "59ffa38b-6928-4a42-8791-b082c7c25007"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:51:39.962027 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.961937 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-console-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:51:39.962075 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.962041 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-oauth-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:51:39.962138 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.962109 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-service-ca" (OuterVolumeSpecName: "service-ca") pod "59ffa38b-6928-4a42-8791-b082c7c25007" (UID: "59ffa38b-6928-4a42-8791-b082c7c25007"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:51:39.963917 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.963894 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59ffa38b-6928-4a42-8791-b082c7c25007" (UID: "59ffa38b-6928-4a42-8791-b082c7c25007"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:51:39.964022 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.963922 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ffa38b-6928-4a42-8791-b082c7c25007-kube-api-access-jrz6v" (OuterVolumeSpecName: "kube-api-access-jrz6v") pod "59ffa38b-6928-4a42-8791-b082c7c25007" (UID: "59ffa38b-6928-4a42-8791-b082c7c25007"). InnerVolumeSpecName "kube-api-access-jrz6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:51:39.964022 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:39.963979 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59ffa38b-6928-4a42-8791-b082c7c25007" (UID: "59ffa38b-6928-4a42-8791-b082c7c25007"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:51:40.062468 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.062440 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59ffa38b-6928-4a42-8791-b082c7c25007-service-ca\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:51:40.062468 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.062463 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:51:40.062468 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.062472 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrz6v\" (UniqueName: \"kubernetes.io/projected/59ffa38b-6928-4a42-8791-b082c7c25007-kube-api-access-jrz6v\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:51:40.062655 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.062481 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59ffa38b-6928-4a42-8791-b082c7c25007-console-oauth-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:51:40.665688 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.665663 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c474f85c4-8sb64_59ffa38b-6928-4a42-8791-b082c7c25007/console/0.log" Jun 03 15:51:40.665854 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.665702 2582 generic.go:358] "Generic (PLEG): container finished" podID="59ffa38b-6928-4a42-8791-b082c7c25007" containerID="24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf" exitCode=2 Jun 03 15:51:40.665854 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.665771 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c474f85c4-8sb64" Jun 03 15:51:40.665854 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.665783 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c474f85c4-8sb64" event={"ID":"59ffa38b-6928-4a42-8791-b082c7c25007","Type":"ContainerDied","Data":"24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf"} Jun 03 15:51:40.665854 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.665808 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c474f85c4-8sb64" event={"ID":"59ffa38b-6928-4a42-8791-b082c7c25007","Type":"ContainerDied","Data":"78ed19f7f9a6c4cc6d4849a55703509dcf705eea79641bb35c91ae50da4d314f"} Jun 03 15:51:40.665854 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.665822 2582 scope.go:117] "RemoveContainer" containerID="24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf" Jun 03 15:51:40.673379 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.673358 2582 scope.go:117] "RemoveContainer" containerID="24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf" Jun 03 15:51:40.673629 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:51:40.673609 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf\": container with ID starting with 24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf not found: ID does not exist" containerID="24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf" Jun 03 15:51:40.673893 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.673640 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf"} err="failed to get container status \"24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf\": rpc error: code = NotFound desc = could not find container \"24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf\": container with ID starting with 24d74a210b7fba868207827754fb8c308da87c7ce12489b445c48511bc3a3ecf not found: ID does not exist" Jun 03 15:51:40.688810 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.688785 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c474f85c4-8sb64"] Jun 03 15:51:40.694157 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:40.694135 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c474f85c4-8sb64"] Jun 03 15:51:42.033737 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:51:42.033707 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59ffa38b-6928-4a42-8791-b082c7c25007" path="/var/lib/kubelet/pods/59ffa38b-6928-4a42-8791-b082c7c25007/volumes" Jun 03 15:52:13.398140 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.398101 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8474cf9b59-qk685"] Jun 03 15:52:13.398671 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.398401 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59ffa38b-6928-4a42-8791-b082c7c25007" containerName="console" Jun 03 15:52:13.398671 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.398413 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59ffa38b-6928-4a42-8791-b082c7c25007" containerName="console" Jun 03 15:52:13.398671 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.398468 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="59ffa38b-6928-4a42-8791-b082c7c25007" containerName="console" Jun 03 15:52:13.401217 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.401188 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.404432 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.404409 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 03 15:52:13.404559 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.404501 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 03 15:52:13.404626 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.404586 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 03 15:52:13.404785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.404764 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 03 15:52:13.404916 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.404796 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 03 15:52:13.405046 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.404990 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fvqqr\"" Jun 03 15:52:13.410141 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.410124 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 03 15:52:13.412992 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.412970 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8474cf9b59-qk685"] Jun 03 15:52:13.509754 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.509724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.509937 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.509762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-secret-telemeter-client\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.509937 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.509785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-telemeter-client-tls\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.509937 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.509804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-serving-certs-ca-bundle\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.509937 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.509895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-metrics-client-ca\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.510135 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.509950 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-federate-client-tls\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.510135 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.509984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjscl\" (UniqueName: \"kubernetes.io/projected/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-kube-api-access-bjscl\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.510135 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.510012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611086 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611047 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-federate-client-tls\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611086 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611089 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjscl\" (UniqueName: \"kubernetes.io/projected/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-kube-api-access-bjscl\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611109 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611148 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611175 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-secret-telemeter-client\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611196 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-telemeter-client-tls\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611221 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-serving-certs-ca-bundle\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.611375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.611253 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-metrics-client-ca\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.612281 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.612232 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.612281 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.612250 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-metrics-client-ca\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.612422 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.612252 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-serving-certs-ca-bundle\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.613928 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.613898 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-secret-telemeter-client\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.614042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.614020 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.614296 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.614280 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-telemeter-client-tls\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.614341 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.614284 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-federate-client-tls\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.624935 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.624906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjscl\" (UniqueName: \"kubernetes.io/projected/b18ffc7a-390f-4b7f-8e3d-291836eea9d7-kube-api-access-bjscl\") pod \"telemeter-client-8474cf9b59-qk685\" (UID: \"b18ffc7a-390f-4b7f-8e3d-291836eea9d7\") " pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.711511 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.711417 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" Jun 03 15:52:13.875772 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:13.875730 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8474cf9b59-qk685"] Jun 03 15:52:13.878333 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:52:13.878301 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18ffc7a_390f_4b7f_8e3d_291836eea9d7.slice/crio-b45890548efc6f1a526079034a1e1d2d30ab7532f9e14e08db2efe54c88d34ba WatchSource:0}: Error finding container b45890548efc6f1a526079034a1e1d2d30ab7532f9e14e08db2efe54c88d34ba: Status 404 returned error can't find the container with id b45890548efc6f1a526079034a1e1d2d30ab7532f9e14e08db2efe54c88d34ba Jun 03 15:52:14.758301 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:14.758243 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" event={"ID":"b18ffc7a-390f-4b7f-8e3d-291836eea9d7","Type":"ContainerStarted","Data":"b45890548efc6f1a526079034a1e1d2d30ab7532f9e14e08db2efe54c88d34ba"} Jun 03 15:52:16.763903 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:16.763869 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" event={"ID":"b18ffc7a-390f-4b7f-8e3d-291836eea9d7","Type":"ContainerStarted","Data":"7377f2f087e53ee4d60522f20edf34b8770c95ed7c0272ec8adc7701cfb59fc5"} Jun 03 15:52:17.770680 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:17.770631 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" event={"ID":"b18ffc7a-390f-4b7f-8e3d-291836eea9d7","Type":"ContainerStarted","Data":"d0a2dca8a196d8d62ec54a12a0953217d40b4cf09490c7ec48c2c2a07e148630"} Jun 03 15:52:17.770680 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:17.770675 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" event={"ID":"b18ffc7a-390f-4b7f-8e3d-291836eea9d7","Type":"ContainerStarted","Data":"da93f03cb3df0abd5aaa2c09298001f9516646fab9c2eab1ef9bfdd6debf9e3c"} Jun 03 15:52:17.798767 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:17.798709 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8474cf9b59-qk685" podStartSLOduration=1.279305619 podStartE2EDuration="4.798696543s" podCreationTimestamp="2026-06-03 15:52:13 +0000 UTC" firstStartedPulling="2026-06-03 15:52:13.880067257 +0000 UTC m=+190.475826929" lastFinishedPulling="2026-06-03 15:52:17.399458178 +0000 UTC m=+193.995217853" observedRunningTime="2026-06-03 15:52:17.796157275 +0000 UTC m=+194.391916968" watchObservedRunningTime="2026-06-03 15:52:17.798696543 +0000 UTC m=+194.394456237" Jun 03 15:52:18.501195 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.501159 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b5f97bdf-p769r"] Jun 03 15:52:18.504002 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.503978 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.518318 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.518288 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b5f97bdf-p769r"] Jun 03 15:52:18.553434 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.553397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-config\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.553434 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.553437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-oauth-serving-cert\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.553703 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.553467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhjfp\" (UniqueName: \"kubernetes.io/projected/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-kube-api-access-bhjfp\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.553703 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.553523 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-service-ca\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.553703 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.553568 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-serving-cert\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.553703 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.553606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-oauth-config\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.553703 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.553686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-trusted-ca-bundle\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.654895 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.654857 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-oauth-serving-cert\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.654895 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.654903 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bhjfp\" (UniqueName: \"kubernetes.io/projected/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-kube-api-access-bhjfp\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.655127 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.654923 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-service-ca\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.655127 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.654961 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-serving-cert\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.655127 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.654996 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-oauth-config\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.655127 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.655025 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-trusted-ca-bundle\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.655127 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.655091 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-config\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.655859 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.655756 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-service-ca\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.655859 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.655783 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-oauth-serving-cert\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.656133 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.655929 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-trusted-ca-bundle\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.656195 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.656186 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-config\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.657643 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.657599 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-oauth-config\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.657749 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.657721 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-serving-cert\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.666478 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.666455 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhjfp\" (UniqueName: \"kubernetes.io/projected/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-kube-api-access-bhjfp\") pod \"console-85b5f97bdf-p769r\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.813860 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.813771 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:18.943985 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:18.943951 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b5f97bdf-p769r"] Jun 03 15:52:18.947713 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:52:18.947684 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622fa3cd_a7ff_4710_a852_5189c9ad9ad2.slice/crio-f3d8643609f86e6479c826b642b6834f8d66a3b4a4cc25e5afe7bbbdd6518abd WatchSource:0}: Error finding container f3d8643609f86e6479c826b642b6834f8d66a3b4a4cc25e5afe7bbbdd6518abd: Status 404 returned error can't find the container with id f3d8643609f86e6479c826b642b6834f8d66a3b4a4cc25e5afe7bbbdd6518abd Jun 03 15:52:19.778632 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:19.778599 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b5f97bdf-p769r" event={"ID":"622fa3cd-a7ff-4710-a852-5189c9ad9ad2","Type":"ContainerStarted","Data":"b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f"} Jun 03 15:52:19.778632 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:19.778633 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b5f97bdf-p769r" event={"ID":"622fa3cd-a7ff-4710-a852-5189c9ad9ad2","Type":"ContainerStarted","Data":"f3d8643609f86e6479c826b642b6834f8d66a3b4a4cc25e5afe7bbbdd6518abd"} Jun 03 15:52:19.805923 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:19.805876 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-85b5f97bdf-p769r" podStartSLOduration=1.805863999 podStartE2EDuration="1.805863999s" podCreationTimestamp="2026-06-03 15:52:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:52:19.805478967 +0000 UTC m=+196.401238663" watchObservedRunningTime="2026-06-03 15:52:19.805863999 +0000 UTC m=+196.401623693" Jun 03 15:52:28.814427 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:28.814398 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:28.814815 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:28.814713 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:28.819081 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:28.819060 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:29.808776 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:29.808749 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:52:29.864651 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:29.864622 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6776664df6-h8kkb"] Jun 03 15:52:54.885342 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:54.885278 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6776664df6-h8kkb" podUID="690eaf4c-52f5-4a17-96d5-3c4348e4a174" containerName="console" containerID="cri-o://dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090" gracePeriod=15 Jun 03 15:52:55.124325 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.124299 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6776664df6-h8kkb_690eaf4c-52f5-4a17-96d5-3c4348e4a174/console/0.log" Jun 03 15:52:55.124470 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.124376 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:52:55.153224 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153136 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-config\") pod \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " Jun 03 15:52:55.153224 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153189 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-oauth-serving-cert\") pod \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " Jun 03 15:52:55.153466 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153233 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-trusted-ca-bundle\") pod \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " Jun 03 15:52:55.153466 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153297 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7sjn\" (UniqueName: \"kubernetes.io/projected/690eaf4c-52f5-4a17-96d5-3c4348e4a174-kube-api-access-c7sjn\") pod \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " Jun 03 15:52:55.153466 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153349 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-service-ca\") pod \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " Jun 03 15:52:55.153466 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153395 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-oauth-config\") pod \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " Jun 03 15:52:55.153466 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153436 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-serving-cert\") pod \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\" (UID: \"690eaf4c-52f5-4a17-96d5-3c4348e4a174\") " Jun 03 15:52:55.153721 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153661 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-config" (OuterVolumeSpecName: "console-config") pod "690eaf4c-52f5-4a17-96d5-3c4348e4a174" (UID: "690eaf4c-52f5-4a17-96d5-3c4348e4a174"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:55.153808 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153781 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "690eaf4c-52f5-4a17-96d5-3c4348e4a174" (UID: "690eaf4c-52f5-4a17-96d5-3c4348e4a174"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:55.153808 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153792 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "690eaf4c-52f5-4a17-96d5-3c4348e4a174" (UID: "690eaf4c-52f5-4a17-96d5-3c4348e4a174"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:55.153913 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.153865 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-service-ca" (OuterVolumeSpecName: "service-ca") pod "690eaf4c-52f5-4a17-96d5-3c4348e4a174" (UID: "690eaf4c-52f5-4a17-96d5-3c4348e4a174"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:52:55.156067 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.156037 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "690eaf4c-52f5-4a17-96d5-3c4348e4a174" (UID: "690eaf4c-52f5-4a17-96d5-3c4348e4a174"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:55.156205 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.156089 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "690eaf4c-52f5-4a17-96d5-3c4348e4a174" (UID: "690eaf4c-52f5-4a17-96d5-3c4348e4a174"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:52:55.156205 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.156101 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690eaf4c-52f5-4a17-96d5-3c4348e4a174-kube-api-access-c7sjn" (OuterVolumeSpecName: "kube-api-access-c7sjn") pod "690eaf4c-52f5-4a17-96d5-3c4348e4a174" (UID: "690eaf4c-52f5-4a17-96d5-3c4348e4a174"). InnerVolumeSpecName "kube-api-access-c7sjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:52:55.254124 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.254076 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-service-ca\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.254124 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.254121 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-oauth-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.254124 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.254132 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.254124 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.254150 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-console-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.254434 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.254159 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-oauth-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.254434 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.254168 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/690eaf4c-52f5-4a17-96d5-3c4348e4a174-trusted-ca-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.254434 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.254178 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7sjn\" (UniqueName: \"kubernetes.io/projected/690eaf4c-52f5-4a17-96d5-3c4348e4a174-kube-api-access-c7sjn\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:52:55.879963 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.879930 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6776664df6-h8kkb_690eaf4c-52f5-4a17-96d5-3c4348e4a174/console/0.log" Jun 03 15:52:55.880138 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.879969 2582 generic.go:358] "Generic (PLEG): container finished" podID="690eaf4c-52f5-4a17-96d5-3c4348e4a174" containerID="dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090" exitCode=2 Jun 03 15:52:55.880138 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.880003 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776664df6-h8kkb" event={"ID":"690eaf4c-52f5-4a17-96d5-3c4348e4a174","Type":"ContainerDied","Data":"dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090"} Jun 03 15:52:55.880138 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.880034 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6776664df6-h8kkb" Jun 03 15:52:55.880138 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.880047 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6776664df6-h8kkb" event={"ID":"690eaf4c-52f5-4a17-96d5-3c4348e4a174","Type":"ContainerDied","Data":"5e3b3d429ff7eb89584d4bf17ec89efa61aa5239e55548ca2078c0970383f900"} Jun 03 15:52:55.880138 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.880063 2582 scope.go:117] "RemoveContainer" containerID="dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090" Jun 03 15:52:55.890859 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.890600 2582 scope.go:117] "RemoveContainer" containerID="dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090" Jun 03 15:52:55.891295 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:52:55.891273 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090\": container with ID starting with dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090 not found: ID does not exist" containerID="dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090" Jun 03 15:52:55.891358 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.891306 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090"} err="failed to get container status \"dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090\": rpc error: code = NotFound desc = could not find container \"dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090\": container with ID starting with dc9e633ec4fff22ddc80e5c2767c8ed71419fd51d125ce5061956095873c5090 not found: ID does not exist" Jun 03 15:52:55.920285 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.920245 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6776664df6-h8kkb"] Jun 03 15:52:55.926227 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:55.926208 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6776664df6-h8kkb"] Jun 03 15:52:56.034633 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:52:56.034598 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="690eaf4c-52f5-4a17-96d5-3c4348e4a174" path="/var/lib/kubelet/pods/690eaf4c-52f5-4a17-96d5-3c4348e4a174/volumes" Jun 03 15:53:44.042583 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.042547 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-585c9d5b77-njbrp"] Jun 03 15:53:44.043005 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.042843 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690eaf4c-52f5-4a17-96d5-3c4348e4a174" containerName="console" Jun 03 15:53:44.043005 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.042854 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="690eaf4c-52f5-4a17-96d5-3c4348e4a174" containerName="console" Jun 03 15:53:44.043005 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.042899 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="690eaf4c-52f5-4a17-96d5-3c4348e4a174" containerName="console" Jun 03 15:53:44.046106 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.046089 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.070402 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.070371 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585c9d5b77-njbrp"] Jun 03 15:53:44.115253 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.115213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-oauth-serving-cert\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.115253 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.115253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-service-ca\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.115503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.115358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-console-config\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.115503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.115394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-serving-cert\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.115503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.115416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-trusted-ca-bundle\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.115503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.115437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq24c\" (UniqueName: \"kubernetes.io/projected/a3aec148-d88e-43a8-929f-f9099d74435f-kube-api-access-bq24c\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.115503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.115481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-oauth-config\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.216721 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.216683 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-trusted-ca-bundle\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.216721 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.216727 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq24c\" (UniqueName: \"kubernetes.io/projected/a3aec148-d88e-43a8-929f-f9099d74435f-kube-api-access-bq24c\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.216946 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.216757 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-oauth-config\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.216946 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.216780 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-oauth-serving-cert\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.216946 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.216801 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-service-ca\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.216946 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.216846 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-console-config\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.216946 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.216879 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-serving-cert\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.217648 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.217620 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-service-ca\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.217648 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.217639 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-trusted-ca-bundle\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.217758 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.217682 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-console-config\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.217793 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.217771 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-oauth-serving-cert\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.219368 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.219348 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-oauth-config\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.219710 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.219693 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-serving-cert\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.228665 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.228638 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq24c\" (UniqueName: \"kubernetes.io/projected/a3aec148-d88e-43a8-929f-f9099d74435f-kube-api-access-bq24c\") pod \"console-585c9d5b77-njbrp\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.354837 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.354733 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:44.479897 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:44.479865 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585c9d5b77-njbrp"] Jun 03 15:53:44.482775 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:53:44.482744 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3aec148_d88e_43a8_929f_f9099d74435f.slice/crio-cd2e2f451ab0ee17367df767870bdeac418304297de9fbe8e82850e897ba70eb WatchSource:0}: Error finding container cd2e2f451ab0ee17367df767870bdeac418304297de9fbe8e82850e897ba70eb: Status 404 returned error can't find the container with id cd2e2f451ab0ee17367df767870bdeac418304297de9fbe8e82850e897ba70eb Jun 03 15:53:45.015375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:45.015337 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9d5b77-njbrp" event={"ID":"a3aec148-d88e-43a8-929f-f9099d74435f","Type":"ContainerStarted","Data":"4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb"} Jun 03 15:53:45.015375 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:45.015376 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9d5b77-njbrp" event={"ID":"a3aec148-d88e-43a8-929f-f9099d74435f","Type":"ContainerStarted","Data":"cd2e2f451ab0ee17367df767870bdeac418304297de9fbe8e82850e897ba70eb"} Jun 03 15:53:45.038992 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:45.038949 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-585c9d5b77-njbrp" podStartSLOduration=1.038934616 podStartE2EDuration="1.038934616s" podCreationTimestamp="2026-06-03 15:53:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:53:45.037318014 +0000 UTC m=+281.633077709" watchObservedRunningTime="2026-06-03 15:53:45.038934616 +0000 UTC m=+281.634694331" Jun 03 15:53:54.355129 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:54.355084 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:54.355129 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:54.355136 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:54.359730 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:54.359704 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:55.051101 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:55.051074 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:53:55.151183 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:53:55.151150 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b5f97bdf-p769r"] Jun 03 15:54:03.909418 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:03.909375 2582 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:54:12.688324 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.688286 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wfz5l"] Jun 03 15:54:12.691429 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.691403 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.694363 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.694337 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:54:12.699415 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.699396 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wfz5l"] Jun 03 15:54:12.740363 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.740326 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5846aab1-b857-4513-9c6c-0cb11d811c4d-dbus\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.740540 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.740402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5846aab1-b857-4513-9c6c-0cb11d811c4d-original-pull-secret\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.740540 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.740430 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5846aab1-b857-4513-9c6c-0cb11d811c4d-kubelet-config\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.841612 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.841577 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5846aab1-b857-4513-9c6c-0cb11d811c4d-dbus\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.841744 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.841638 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5846aab1-b857-4513-9c6c-0cb11d811c4d-original-pull-secret\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.841744 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.841657 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5846aab1-b857-4513-9c6c-0cb11d811c4d-kubelet-config\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.841744 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.841739 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5846aab1-b857-4513-9c6c-0cb11d811c4d-kubelet-config\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.841847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.841763 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5846aab1-b857-4513-9c6c-0cb11d811c4d-dbus\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:12.843974 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:12.843949 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5846aab1-b857-4513-9c6c-0cb11d811c4d-original-pull-secret\") pod \"global-pull-secret-syncer-wfz5l\" (UID: \"5846aab1-b857-4513-9c6c-0cb11d811c4d\") " pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:13.001171 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:13.001137 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wfz5l" Jun 03 15:54:13.133401 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:13.133322 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wfz5l"] Jun 03 15:54:13.136030 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:54:13.136006 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5846aab1_b857_4513_9c6c_0cb11d811c4d.slice/crio-b649dea8062216a1b2744fd83426e0ded8d241cc53700cd4a0d3d80eed40c7d6 WatchSource:0}: Error finding container b649dea8062216a1b2744fd83426e0ded8d241cc53700cd4a0d3d80eed40c7d6: Status 404 returned error can't find the container with id b649dea8062216a1b2744fd83426e0ded8d241cc53700cd4a0d3d80eed40c7d6 Jun 03 15:54:13.137693 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:13.137672 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:54:14.100494 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:14.100451 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wfz5l" event={"ID":"5846aab1-b857-4513-9c6c-0cb11d811c4d","Type":"ContainerStarted","Data":"b649dea8062216a1b2744fd83426e0ded8d241cc53700cd4a0d3d80eed40c7d6"} Jun 03 15:54:19.114405 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:19.114363 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wfz5l" event={"ID":"5846aab1-b857-4513-9c6c-0cb11d811c4d","Type":"ContainerStarted","Data":"ae5030afb426394b03cd2735dcd9f5f7dbd9d8e12d7732c762c873d4201ad160"} Jun 03 15:54:19.134844 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:19.134794 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wfz5l" podStartSLOduration=2.159911643 podStartE2EDuration="7.134780463s" podCreationTimestamp="2026-06-03 15:54:12 +0000 UTC" firstStartedPulling="2026-06-03 15:54:13.137798522 +0000 UTC m=+309.733558194" lastFinishedPulling="2026-06-03 15:54:18.112667343 +0000 UTC m=+314.708427014" observedRunningTime="2026-06-03 15:54:19.133452144 +0000 UTC m=+315.729211838" watchObservedRunningTime="2026-06-03 15:54:19.134780463 +0000 UTC m=+315.730540198" Jun 03 15:54:20.171891 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.171853 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-85b5f97bdf-p769r" podUID="622fa3cd-a7ff-4710-a852-5189c9ad9ad2" containerName="console" containerID="cri-o://b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f" gracePeriod=15 Jun 03 15:54:20.408530 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.408507 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85b5f97bdf-p769r_622fa3cd-a7ff-4710-a852-5189c9ad9ad2/console/0.log" Jun 03 15:54:20.408640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.408570 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:54:20.503354 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503327 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-service-ca\") pod \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " Jun 03 15:54:20.503515 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503392 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-oauth-serving-cert\") pod \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " Jun 03 15:54:20.503515 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503414 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-trusted-ca-bundle\") pod \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " Jun 03 15:54:20.503515 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503437 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhjfp\" (UniqueName: \"kubernetes.io/projected/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-kube-api-access-bhjfp\") pod \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " Jun 03 15:54:20.503515 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503465 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-serving-cert\") pod \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " Jun 03 15:54:20.503515 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503502 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-config\") pod \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " Jun 03 15:54:20.503741 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503577 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-oauth-config\") pod \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\" (UID: \"622fa3cd-a7ff-4710-a852-5189c9ad9ad2\") " Jun 03 15:54:20.503867 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503821 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-service-ca" (OuterVolumeSpecName: "service-ca") pod "622fa3cd-a7ff-4710-a852-5189c9ad9ad2" (UID: "622fa3cd-a7ff-4710-a852-5189c9ad9ad2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:54:20.503867 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503866 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "622fa3cd-a7ff-4710-a852-5189c9ad9ad2" (UID: "622fa3cd-a7ff-4710-a852-5189c9ad9ad2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:54:20.504016 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503897 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-config" (OuterVolumeSpecName: "console-config") pod "622fa3cd-a7ff-4710-a852-5189c9ad9ad2" (UID: "622fa3cd-a7ff-4710-a852-5189c9ad9ad2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:54:20.504016 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.503904 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "622fa3cd-a7ff-4710-a852-5189c9ad9ad2" (UID: "622fa3cd-a7ff-4710-a852-5189c9ad9ad2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:54:20.505792 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.505768 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-kube-api-access-bhjfp" (OuterVolumeSpecName: "kube-api-access-bhjfp") pod "622fa3cd-a7ff-4710-a852-5189c9ad9ad2" (UID: "622fa3cd-a7ff-4710-a852-5189c9ad9ad2"). InnerVolumeSpecName "kube-api-access-bhjfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:54:20.505888 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.505858 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "622fa3cd-a7ff-4710-a852-5189c9ad9ad2" (UID: "622fa3cd-a7ff-4710-a852-5189c9ad9ad2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:54:20.505964 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.505941 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "622fa3cd-a7ff-4710-a852-5189c9ad9ad2" (UID: "622fa3cd-a7ff-4710-a852-5189c9ad9ad2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:54:20.604950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.604910 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-oauth-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:54:20.604950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.604942 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-trusted-ca-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:54:20.604950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.604952 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhjfp\" (UniqueName: \"kubernetes.io/projected/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-kube-api-access-bhjfp\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:54:20.604950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.604961 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:54:20.605243 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.604972 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:54:20.605243 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.604982 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-console-oauth-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:54:20.605243 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:20.604990 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/622fa3cd-a7ff-4710-a852-5189c9ad9ad2-service-ca\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:54:21.121503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.121477 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85b5f97bdf-p769r_622fa3cd-a7ff-4710-a852-5189c9ad9ad2/console/0.log" Jun 03 15:54:21.121669 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.121514 2582 generic.go:358] "Generic (PLEG): container finished" podID="622fa3cd-a7ff-4710-a852-5189c9ad9ad2" containerID="b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f" exitCode=2 Jun 03 15:54:21.121669 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.121559 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b5f97bdf-p769r" event={"ID":"622fa3cd-a7ff-4710-a852-5189c9ad9ad2","Type":"ContainerDied","Data":"b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f"} Jun 03 15:54:21.121669 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.121581 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b5f97bdf-p769r" event={"ID":"622fa3cd-a7ff-4710-a852-5189c9ad9ad2","Type":"ContainerDied","Data":"f3d8643609f86e6479c826b642b6834f8d66a3b4a4cc25e5afe7bbbdd6518abd"} Jun 03 15:54:21.121669 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.121590 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b5f97bdf-p769r" Jun 03 15:54:21.121808 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.121597 2582 scope.go:117] "RemoveContainer" containerID="b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f" Jun 03 15:54:21.130171 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.130151 2582 scope.go:117] "RemoveContainer" containerID="b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f" Jun 03 15:54:21.130441 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:54:21.130425 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f\": container with ID starting with b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f not found: ID does not exist" containerID="b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f" Jun 03 15:54:21.130500 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.130450 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f"} err="failed to get container status \"b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f\": rpc error: code = NotFound desc = could not find container \"b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f\": container with ID starting with b094af6411663386cb93aa470a5b58d52a4261362620a4ac47cefc71009b066f not found: ID does not exist" Jun 03 15:54:21.146442 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.146417 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b5f97bdf-p769r"] Jun 03 15:54:21.151591 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:21.151572 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85b5f97bdf-p769r"] Jun 03 15:54:22.034400 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:54:22.034370 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="622fa3cd-a7ff-4710-a852-5189c9ad9ad2" path="/var/lib/kubelet/pods/622fa3cd-a7ff-4710-a852-5189c9ad9ad2/volumes" Jun 03 15:55:12.705781 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.705741 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp"] Jun 03 15:55:12.706307 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.706023 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622fa3cd-a7ff-4710-a852-5189c9ad9ad2" containerName="console" Jun 03 15:55:12.706307 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.706034 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="622fa3cd-a7ff-4710-a852-5189c9ad9ad2" containerName="console" Jun 03 15:55:12.706307 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.706082 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="622fa3cd-a7ff-4710-a852-5189c9ad9ad2" containerName="console" Jun 03 15:55:12.708983 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.708967 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.712702 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.712683 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:55:12.712895 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.712882 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-flvl5\"" Jun 03 15:55:12.714104 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.714089 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:55:12.724734 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.724709 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp"] Jun 03 15:55:12.815707 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.815671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.815874 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.815714 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.815874 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.815736 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qz7\" (UniqueName: \"kubernetes.io/projected/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-kube-api-access-g2qz7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.916618 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.916587 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.916735 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.916636 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.916776 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.916755 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qz7\" (UniqueName: \"kubernetes.io/projected/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-kube-api-access-g2qz7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.917064 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.917045 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.917102 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.917063 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:12.928503 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:12.928475 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qz7\" (UniqueName: \"kubernetes.io/projected/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-kube-api-access-g2qz7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:13.017735 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:13.017705 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:13.149870 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:13.149815 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp"] Jun 03 15:55:13.153677 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:55:13.153642 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e817d6f_c2ed_40b1_8694_b5859b76fe3b.slice/crio-ffcd0689727ac0d886c957d06f4459ea2f4e17885da8026a1430eadc9c2887f9 WatchSource:0}: Error finding container ffcd0689727ac0d886c957d06f4459ea2f4e17885da8026a1430eadc9c2887f9: Status 404 returned error can't find the container with id ffcd0689727ac0d886c957d06f4459ea2f4e17885da8026a1430eadc9c2887f9 Jun 03 15:55:13.263936 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:13.263896 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" event={"ID":"0e817d6f-c2ed-40b1-8694-b5859b76fe3b","Type":"ContainerStarted","Data":"ffcd0689727ac0d886c957d06f4459ea2f4e17885da8026a1430eadc9c2887f9"} Jun 03 15:55:21.286385 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:21.286342 2582 generic.go:358] "Generic (PLEG): container finished" podID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerID="ea3c3a9d5deccb263f1948df70b415a05c02d0cdaa4eaae3a113bf116559a24c" exitCode=0 Jun 03 15:55:21.286885 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:21.286435 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" event={"ID":"0e817d6f-c2ed-40b1-8694-b5859b76fe3b","Type":"ContainerDied","Data":"ea3c3a9d5deccb263f1948df70b415a05c02d0cdaa4eaae3a113bf116559a24c"} Jun 03 15:55:24.295729 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:24.295684 2582 generic.go:358] "Generic (PLEG): container finished" podID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerID="d6b5e5bc77cac944f1f3755266a4ddb3d7fc504a637898179dd7af26d112f6a8" exitCode=0 Jun 03 15:55:24.296127 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:24.295763 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" event={"ID":"0e817d6f-c2ed-40b1-8694-b5859b76fe3b","Type":"ContainerDied","Data":"d6b5e5bc77cac944f1f3755266a4ddb3d7fc504a637898179dd7af26d112f6a8"} Jun 03 15:55:32.319706 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:32.319668 2582 generic.go:358] "Generic (PLEG): container finished" podID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerID="0a2c46d80cb180c5bba455d0f02395d0be7ec4981465f5f4c19699fddc5f9f6a" exitCode=0 Jun 03 15:55:32.320131 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:32.319767 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" event={"ID":"0e817d6f-c2ed-40b1-8694-b5859b76fe3b","Type":"ContainerDied","Data":"0a2c46d80cb180c5bba455d0f02395d0be7ec4981465f5f4c19699fddc5f9f6a"} Jun 03 15:55:33.445573 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.445551 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:33.487916 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.487891 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-bundle\") pod \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " Jun 03 15:55:33.488044 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.487973 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2qz7\" (UniqueName: \"kubernetes.io/projected/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-kube-api-access-g2qz7\") pod \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " Jun 03 15:55:33.488085 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.488045 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-util\") pod \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\" (UID: \"0e817d6f-c2ed-40b1-8694-b5859b76fe3b\") " Jun 03 15:55:33.488677 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.488656 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-bundle" (OuterVolumeSpecName: "bundle") pod "0e817d6f-c2ed-40b1-8694-b5859b76fe3b" (UID: "0e817d6f-c2ed-40b1-8694-b5859b76fe3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:55:33.490226 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.490204 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-kube-api-access-g2qz7" (OuterVolumeSpecName: "kube-api-access-g2qz7") pod "0e817d6f-c2ed-40b1-8694-b5859b76fe3b" (UID: "0e817d6f-c2ed-40b1-8694-b5859b76fe3b"). InnerVolumeSpecName "kube-api-access-g2qz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:55:33.493528 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.493507 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-util" (OuterVolumeSpecName: "util") pod "0e817d6f-c2ed-40b1-8694-b5859b76fe3b" (UID: "0e817d6f-c2ed-40b1-8694-b5859b76fe3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:55:33.589349 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.589248 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:55:33.589349 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.589291 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:55:33.589349 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:33.589300 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2qz7\" (UniqueName: \"kubernetes.io/projected/0e817d6f-c2ed-40b1-8694-b5859b76fe3b-kube-api-access-g2qz7\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:55:34.327292 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:34.327195 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" Jun 03 15:55:34.327292 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:34.327191 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d4g2gp" event={"ID":"0e817d6f-c2ed-40b1-8694-b5859b76fe3b","Type":"ContainerDied","Data":"ffcd0689727ac0d886c957d06f4459ea2f4e17885da8026a1430eadc9c2887f9"} Jun 03 15:55:34.327467 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:34.327299 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffcd0689727ac0d886c957d06f4459ea2f4e17885da8026a1430eadc9c2887f9" Jun 03 15:55:40.529393 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529351 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq"] Jun 03 15:55:40.529847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529634 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerName="extract" Jun 03 15:55:40.529847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529645 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerName="extract" Jun 03 15:55:40.529847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529658 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerName="util" Jun 03 15:55:40.529847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529663 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerName="util" Jun 03 15:55:40.529847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529676 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerName="pull" Jun 03 15:55:40.529847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529681 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerName="pull" Jun 03 15:55:40.529847 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.529727 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e817d6f-c2ed-40b1-8694-b5859b76fe3b" containerName="extract" Jun 03 15:55:40.533976 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.533959 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.537755 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.537730 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m2v2s\"" Jun 03 15:55:40.538027 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.538013 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 15:55:40.538088 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.538071 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:55:40.546978 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.546954 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq"] Jun 03 15:55:40.637741 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.637700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dchv\" (UniqueName: \"kubernetes.io/projected/73133bd8-c270-4e54-86cb-7c74f24ce3e4-kube-api-access-4dchv\") pod \"cert-manager-operator-controller-manager-54b9655956-85jkq\" (UID: \"73133bd8-c270-4e54-86cb-7c74f24ce3e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.637918 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.637785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73133bd8-c270-4e54-86cb-7c74f24ce3e4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-85jkq\" (UID: \"73133bd8-c270-4e54-86cb-7c74f24ce3e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.738521 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.738483 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73133bd8-c270-4e54-86cb-7c74f24ce3e4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-85jkq\" (UID: \"73133bd8-c270-4e54-86cb-7c74f24ce3e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.738687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.738560 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dchv\" (UniqueName: \"kubernetes.io/projected/73133bd8-c270-4e54-86cb-7c74f24ce3e4-kube-api-access-4dchv\") pod \"cert-manager-operator-controller-manager-54b9655956-85jkq\" (UID: \"73133bd8-c270-4e54-86cb-7c74f24ce3e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.738943 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.738924 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73133bd8-c270-4e54-86cb-7c74f24ce3e4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-85jkq\" (UID: \"73133bd8-c270-4e54-86cb-7c74f24ce3e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.750773 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.750754 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dchv\" (UniqueName: \"kubernetes.io/projected/73133bd8-c270-4e54-86cb-7c74f24ce3e4-kube-api-access-4dchv\") pod \"cert-manager-operator-controller-manager-54b9655956-85jkq\" (UID: \"73133bd8-c270-4e54-86cb-7c74f24ce3e4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.843085 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.843001 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" Jun 03 15:55:40.981191 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:40.981165 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq"] Jun 03 15:55:40.983240 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:55:40.983214 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73133bd8_c270_4e54_86cb_7c74f24ce3e4.slice/crio-3dd90a187c4e2b8d6b4eed4a7492d2f1f4b7f2c6de5ddc64d8e36c70228ac3d4 WatchSource:0}: Error finding container 3dd90a187c4e2b8d6b4eed4a7492d2f1f4b7f2c6de5ddc64d8e36c70228ac3d4: Status 404 returned error can't find the container with id 3dd90a187c4e2b8d6b4eed4a7492d2f1f4b7f2c6de5ddc64d8e36c70228ac3d4 Jun 03 15:55:41.348013 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:41.347977 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" event={"ID":"73133bd8-c270-4e54-86cb-7c74f24ce3e4","Type":"ContainerStarted","Data":"3dd90a187c4e2b8d6b4eed4a7492d2f1f4b7f2c6de5ddc64d8e36c70228ac3d4"} Jun 03 15:55:43.356568 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:43.356535 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" event={"ID":"73133bd8-c270-4e54-86cb-7c74f24ce3e4","Type":"ContainerStarted","Data":"b406cf31e042e763bbb50816f74a1b2e4cc182a6ebaf935a12c7bf7516b20861"} Jun 03 15:55:43.387878 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:43.387827 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-85jkq" podStartSLOduration=1.599275552 podStartE2EDuration="3.387811775s" podCreationTimestamp="2026-06-03 15:55:40 +0000 UTC" firstStartedPulling="2026-06-03 15:55:40.986528549 +0000 UTC m=+397.582288221" lastFinishedPulling="2026-06-03 15:55:42.775064769 +0000 UTC m=+399.370824444" observedRunningTime="2026-06-03 15:55:43.385117773 +0000 UTC m=+399.980877468" watchObservedRunningTime="2026-06-03 15:55:43.387811775 +0000 UTC m=+399.983571469" Jun 03 15:55:45.215731 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.215694 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn"] Jun 03 15:55:45.218681 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.218665 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.221920 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.221899 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:55:45.222035 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.221948 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:55:45.223178 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.223159 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-flvl5\"" Jun 03 15:55:45.229239 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.229216 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn"] Jun 03 15:55:45.274417 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.274389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2t29\" (UniqueName: \"kubernetes.io/projected/0e328977-f7b1-448d-8b08-7c10eed69a5d-kube-api-access-n2t29\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.274559 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.274423 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.274559 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.274467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.375561 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.375532 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.375704 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.375601 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2t29\" (UniqueName: \"kubernetes.io/projected/0e328977-f7b1-448d-8b08-7c10eed69a5d-kube-api-access-n2t29\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.375704 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.375624 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.375923 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.375906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.375959 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.375946 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.385809 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.385782 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2t29\" (UniqueName: \"kubernetes.io/projected/0e328977-f7b1-448d-8b08-7c10eed69a5d-kube-api-access-n2t29\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.527608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.527579 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:45.656122 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:45.656095 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn"] Jun 03 15:55:45.658095 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:55:45.658070 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e328977_f7b1_448d_8b08_7c10eed69a5d.slice/crio-87b9e43dd3533992c863989b93d41f6a89caaa25e05e13b10ee3757f6e57c3a0 WatchSource:0}: Error finding container 87b9e43dd3533992c863989b93d41f6a89caaa25e05e13b10ee3757f6e57c3a0: Status 404 returned error can't find the container with id 87b9e43dd3533992c863989b93d41f6a89caaa25e05e13b10ee3757f6e57c3a0 Jun 03 15:55:46.237446 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.235216 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-8tfjv"] Jun 03 15:55:46.238502 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.238477 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.241386 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.241359 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 15:55:46.241497 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.241388 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 15:55:46.241497 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.241405 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-f7sbp\"" Jun 03 15:55:46.246505 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.246483 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-8tfjv"] Jun 03 15:55:46.282195 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.282163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/390a5f17-c499-44f3-92c5-7a7f797d1cd2-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-8tfjv\" (UID: \"390a5f17-c499-44f3-92c5-7a7f797d1cd2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.282363 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.282207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbpwc\" (UniqueName: \"kubernetes.io/projected/390a5f17-c499-44f3-92c5-7a7f797d1cd2-kube-api-access-nbpwc\") pod \"cert-manager-webhook-587ccfb98-8tfjv\" (UID: \"390a5f17-c499-44f3-92c5-7a7f797d1cd2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.367297 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.367239 2582 generic.go:358] "Generic (PLEG): container finished" podID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerID="ee590792fada400bacdc6ebdcc5e01234627547225793389f9dd761928938020" exitCode=0 Jun 03 15:55:46.367464 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.367308 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" event={"ID":"0e328977-f7b1-448d-8b08-7c10eed69a5d","Type":"ContainerDied","Data":"ee590792fada400bacdc6ebdcc5e01234627547225793389f9dd761928938020"} Jun 03 15:55:46.367464 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.367344 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" event={"ID":"0e328977-f7b1-448d-8b08-7c10eed69a5d","Type":"ContainerStarted","Data":"87b9e43dd3533992c863989b93d41f6a89caaa25e05e13b10ee3757f6e57c3a0"} Jun 03 15:55:46.383579 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.383547 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/390a5f17-c499-44f3-92c5-7a7f797d1cd2-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-8tfjv\" (UID: \"390a5f17-c499-44f3-92c5-7a7f797d1cd2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.383760 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.383601 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbpwc\" (UniqueName: \"kubernetes.io/projected/390a5f17-c499-44f3-92c5-7a7f797d1cd2-kube-api-access-nbpwc\") pod \"cert-manager-webhook-587ccfb98-8tfjv\" (UID: \"390a5f17-c499-44f3-92c5-7a7f797d1cd2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.394052 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.394020 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/390a5f17-c499-44f3-92c5-7a7f797d1cd2-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-8tfjv\" (UID: \"390a5f17-c499-44f3-92c5-7a7f797d1cd2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.394154 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.394026 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbpwc\" (UniqueName: \"kubernetes.io/projected/390a5f17-c499-44f3-92c5-7a7f797d1cd2-kube-api-access-nbpwc\") pod \"cert-manager-webhook-587ccfb98-8tfjv\" (UID: \"390a5f17-c499-44f3-92c5-7a7f797d1cd2\") " pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.564348 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.564218 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:46.697957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:46.697922 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-8tfjv"] Jun 03 15:55:46.699031 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:55:46.699002 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod390a5f17_c499_44f3_92c5_7a7f797d1cd2.slice/crio-0a7f7fe3acaae86fa58a6bcea245d94caada750bcd9f18b2a52718994ccea0d7 WatchSource:0}: Error finding container 0a7f7fe3acaae86fa58a6bcea245d94caada750bcd9f18b2a52718994ccea0d7: Status 404 returned error can't find the container with id 0a7f7fe3acaae86fa58a6bcea245d94caada750bcd9f18b2a52718994ccea0d7 Jun 03 15:55:47.371318 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:47.371280 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" event={"ID":"390a5f17-c499-44f3-92c5-7a7f797d1cd2","Type":"ContainerStarted","Data":"0a7f7fe3acaae86fa58a6bcea245d94caada750bcd9f18b2a52718994ccea0d7"} Jun 03 15:55:48.522915 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.522883 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vppl2"] Jun 03 15:55:48.525440 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.525417 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:48.528470 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.528453 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5qsd8\"" Jun 03 15:55:48.538152 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.538130 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vppl2"] Jun 03 15:55:48.604360 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.604330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjjj\" (UniqueName: \"kubernetes.io/projected/eb74d189-f611-4dff-bf4c-098dda0bddd9-kube-api-access-zdjjj\") pod \"cert-manager-cainjector-68b757865b-vppl2\" (UID: \"eb74d189-f611-4dff-bf4c-098dda0bddd9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:48.604544 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.604474 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb74d189-f611-4dff-bf4c-098dda0bddd9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vppl2\" (UID: \"eb74d189-f611-4dff-bf4c-098dda0bddd9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:48.705027 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.704977 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb74d189-f611-4dff-bf4c-098dda0bddd9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vppl2\" (UID: \"eb74d189-f611-4dff-bf4c-098dda0bddd9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:48.705027 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.705027 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjjj\" (UniqueName: \"kubernetes.io/projected/eb74d189-f611-4dff-bf4c-098dda0bddd9-kube-api-access-zdjjj\") pod \"cert-manager-cainjector-68b757865b-vppl2\" (UID: \"eb74d189-f611-4dff-bf4c-098dda0bddd9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:48.718190 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.718163 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb74d189-f611-4dff-bf4c-098dda0bddd9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vppl2\" (UID: \"eb74d189-f611-4dff-bf4c-098dda0bddd9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:48.718417 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.718390 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjjj\" (UniqueName: \"kubernetes.io/projected/eb74d189-f611-4dff-bf4c-098dda0bddd9-kube-api-access-zdjjj\") pod \"cert-manager-cainjector-68b757865b-vppl2\" (UID: \"eb74d189-f611-4dff-bf4c-098dda0bddd9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:48.836060 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:48.835976 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" Jun 03 15:55:50.234881 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.234843 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vppl2"] Jun 03 15:55:50.238219 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:55:50.238189 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb74d189_f611_4dff_bf4c_098dda0bddd9.slice/crio-b2c4c155acce96d7e55bcf903f9c3f6e48c11c3b93f3a8568dd527fe241ee949 WatchSource:0}: Error finding container b2c4c155acce96d7e55bcf903f9c3f6e48c11c3b93f3a8568dd527fe241ee949: Status 404 returned error can't find the container with id b2c4c155acce96d7e55bcf903f9c3f6e48c11c3b93f3a8568dd527fe241ee949 Jun 03 15:55:50.389330 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.389295 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" event={"ID":"390a5f17-c499-44f3-92c5-7a7f797d1cd2","Type":"ContainerStarted","Data":"978ea5a96987a80080db23e7617e138f29ebe09ac7eba1ebf9307b02835b1a00"} Jun 03 15:55:50.389330 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.389337 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:50.390998 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.390956 2582 generic.go:358] "Generic (PLEG): container finished" podID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerID="b62f87a58c7c540e797c81c7dba281f01b4acced069f5388d2e64a05e1e152f9" exitCode=0 Jun 03 15:55:50.391114 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.391036 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" event={"ID":"0e328977-f7b1-448d-8b08-7c10eed69a5d","Type":"ContainerDied","Data":"b62f87a58c7c540e797c81c7dba281f01b4acced069f5388d2e64a05e1e152f9"} Jun 03 15:55:50.392401 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.392378 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" event={"ID":"eb74d189-f611-4dff-bf4c-098dda0bddd9","Type":"ContainerStarted","Data":"34d1b6108b92fef06cab11026ce78f7d4262ef762743b89430dcb40481aa46ae"} Jun 03 15:55:50.392507 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.392409 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" event={"ID":"eb74d189-f611-4dff-bf4c-098dda0bddd9","Type":"ContainerStarted","Data":"b2c4c155acce96d7e55bcf903f9c3f6e48c11c3b93f3a8568dd527fe241ee949"} Jun 03 15:55:50.408925 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.408866 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" podStartSLOduration=1.008866807 podStartE2EDuration="4.408847635s" podCreationTimestamp="2026-06-03 15:55:46 +0000 UTC" firstStartedPulling="2026-06-03 15:55:46.700801282 +0000 UTC m=+403.296560955" lastFinishedPulling="2026-06-03 15:55:50.100782098 +0000 UTC m=+406.696541783" observedRunningTime="2026-06-03 15:55:50.406502547 +0000 UTC m=+407.002262254" watchObservedRunningTime="2026-06-03 15:55:50.408847635 +0000 UTC m=+407.004607329" Jun 03 15:55:50.424294 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:50.424221 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-vppl2" podStartSLOduration=2.424202819 podStartE2EDuration="2.424202819s" podCreationTimestamp="2026-06-03 15:55:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:55:50.423671682 +0000 UTC m=+407.019431375" watchObservedRunningTime="2026-06-03 15:55:50.424202819 +0000 UTC m=+407.019962512" Jun 03 15:55:51.397322 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:51.397225 2582 generic.go:358] "Generic (PLEG): container finished" podID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerID="31bf9a2aca4e12b28962ca0346d7dc4839dfa543959abd81011d152b5250b6aa" exitCode=0 Jun 03 15:55:51.397676 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:51.397307 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" event={"ID":"0e328977-f7b1-448d-8b08-7c10eed69a5d","Type":"ContainerDied","Data":"31bf9a2aca4e12b28962ca0346d7dc4839dfa543959abd81011d152b5250b6aa"} Jun 03 15:55:52.530723 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.530692 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:52.638575 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.638538 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2t29\" (UniqueName: \"kubernetes.io/projected/0e328977-f7b1-448d-8b08-7c10eed69a5d-kube-api-access-n2t29\") pod \"0e328977-f7b1-448d-8b08-7c10eed69a5d\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " Jun 03 15:55:52.638575 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.638581 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-bundle\") pod \"0e328977-f7b1-448d-8b08-7c10eed69a5d\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " Jun 03 15:55:52.638796 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.638622 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-util\") pod \"0e328977-f7b1-448d-8b08-7c10eed69a5d\" (UID: \"0e328977-f7b1-448d-8b08-7c10eed69a5d\") " Jun 03 15:55:52.639065 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.639035 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-bundle" (OuterVolumeSpecName: "bundle") pod "0e328977-f7b1-448d-8b08-7c10eed69a5d" (UID: "0e328977-f7b1-448d-8b08-7c10eed69a5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:55:52.640921 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.640895 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e328977-f7b1-448d-8b08-7c10eed69a5d-kube-api-access-n2t29" (OuterVolumeSpecName: "kube-api-access-n2t29") pod "0e328977-f7b1-448d-8b08-7c10eed69a5d" (UID: "0e328977-f7b1-448d-8b08-7c10eed69a5d"). InnerVolumeSpecName "kube-api-access-n2t29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:55:52.643616 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.643581 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-util" (OuterVolumeSpecName: "util") pod "0e328977-f7b1-448d-8b08-7c10eed69a5d" (UID: "0e328977-f7b1-448d-8b08-7c10eed69a5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:55:52.739894 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.739864 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2t29\" (UniqueName: \"kubernetes.io/projected/0e328977-f7b1-448d-8b08-7c10eed69a5d-kube-api-access-n2t29\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:55:52.739894 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.739894 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:55:52.740085 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:52.739904 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e328977-f7b1-448d-8b08-7c10eed69a5d-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:55:53.405600 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:53.405566 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" event={"ID":"0e328977-f7b1-448d-8b08-7c10eed69a5d","Type":"ContainerDied","Data":"87b9e43dd3533992c863989b93d41f6a89caaa25e05e13b10ee3757f6e57c3a0"} Jun 03 15:55:53.405600 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:53.405599 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87b9e43dd3533992c863989b93d41f6a89caaa25e05e13b10ee3757f6e57c3a0" Jun 03 15:55:53.405848 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:53.405607 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8t2vn" Jun 03 15:55:56.399584 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:56.399548 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-8tfjv" Jun 03 15:55:57.652210 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652174 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv"] Jun 03 15:55:57.652607 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652561 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerName="pull" Jun 03 15:55:57.652607 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652576 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerName="pull" Jun 03 15:55:57.652607 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652586 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerName="util" Jun 03 15:55:57.652607 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652591 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerName="util" Jun 03 15:55:57.652607 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652608 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerName="extract" Jun 03 15:55:57.652793 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652614 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerName="extract" Jun 03 15:55:57.652793 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.652660 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e328977-f7b1-448d-8b08-7c10eed69a5d" containerName="extract" Jun 03 15:55:57.655030 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.655013 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:57.658242 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.658214 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 15:55:57.659587 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.659569 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:55:57.659689 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.659568 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q594m\"" Jun 03 15:55:57.663386 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.663364 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv"] Jun 03 15:55:57.782965 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.782925 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpb82\" (UniqueName: \"kubernetes.io/projected/cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca-kube-api-access-qpb82\") pod \"openshift-lws-operator-bfc7f696d-gpkwv\" (UID: \"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:57.782965 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.782967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca-tmp\") pod \"openshift-lws-operator-bfc7f696d-gpkwv\" (UID: \"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:57.884128 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.884086 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpb82\" (UniqueName: \"kubernetes.io/projected/cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca-kube-api-access-qpb82\") pod \"openshift-lws-operator-bfc7f696d-gpkwv\" (UID: \"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:57.884311 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.884138 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca-tmp\") pod \"openshift-lws-operator-bfc7f696d-gpkwv\" (UID: \"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:57.884557 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.884538 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca-tmp\") pod \"openshift-lws-operator-bfc7f696d-gpkwv\" (UID: \"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:57.894314 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.894296 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpb82\" (UniqueName: \"kubernetes.io/projected/cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca-kube-api-access-qpb82\") pod \"openshift-lws-operator-bfc7f696d-gpkwv\" (UID: \"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:57.964936 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:57.964852 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" Jun 03 15:55:58.090895 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:58.090869 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv"] Jun 03 15:55:58.093021 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:55:58.092990 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb9b9ea8_7237_4bd9_b30c_3169bfc5a6ca.slice/crio-82f67f7a0bd3181d8f7cb122c7fb8fc667484ee06d7b625699b61dcfccba22cf WatchSource:0}: Error finding container 82f67f7a0bd3181d8f7cb122c7fb8fc667484ee06d7b625699b61dcfccba22cf: Status 404 returned error can't find the container with id 82f67f7a0bd3181d8f7cb122c7fb8fc667484ee06d7b625699b61dcfccba22cf Jun 03 15:55:58.422018 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:55:58.421983 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" event={"ID":"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca","Type":"ContainerStarted","Data":"82f67f7a0bd3181d8f7cb122c7fb8fc667484ee06d7b625699b61dcfccba22cf"} Jun 03 15:56:02.437129 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:02.437095 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" event={"ID":"cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca","Type":"ContainerStarted","Data":"9d76ca0f8e80f7d6bb1e34fcd5d5d339f776a92764f9e239035c06b20fc0410b"} Jun 03 15:56:02.459053 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:02.458945 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-gpkwv" podStartSLOduration=1.360890365 podStartE2EDuration="5.458927538s" podCreationTimestamp="2026-06-03 15:55:57 +0000 UTC" firstStartedPulling="2026-06-03 15:55:58.09443617 +0000 UTC m=+414.690195842" lastFinishedPulling="2026-06-03 15:56:02.192473329 +0000 UTC m=+418.788233015" observedRunningTime="2026-06-03 15:56:02.457543609 +0000 UTC m=+419.053303304" watchObservedRunningTime="2026-06-03 15:56:02.458927538 +0000 UTC m=+419.054687232" Jun 03 15:56:04.690156 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.690117 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd"] Jun 03 15:56:04.692544 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.692528 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.695746 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.695726 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:56:04.696876 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.696861 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-flvl5\"" Jun 03 15:56:04.696949 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.696881 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:56:04.701369 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.701322 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd"] Jun 03 15:56:04.841712 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.841676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.841901 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.841763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.841901 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.841785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4dd\" (UniqueName: \"kubernetes.io/projected/7403af54-7880-429f-8d2f-7dbaf01fc599-kube-api-access-gk4dd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.942844 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.942742 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.942844 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.942793 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4dd\" (UniqueName: \"kubernetes.io/projected/7403af54-7880-429f-8d2f-7dbaf01fc599-kube-api-access-gk4dd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.943070 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.942847 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.943241 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.943216 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.943355 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.943254 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:04.957273 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:04.957237 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4dd\" (UniqueName: \"kubernetes.io/projected/7403af54-7880-429f-8d2f-7dbaf01fc599-kube-api-access-gk4dd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:05.002195 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:05.002161 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:05.136411 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:05.136385 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd"] Jun 03 15:56:05.138356 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:56:05.138326 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7403af54_7880_429f_8d2f_7dbaf01fc599.slice/crio-64d60756d004b31cf5152fffce49ebed6e4bb904d60d3e2be75438c0e4f65dcf WatchSource:0}: Error finding container 64d60756d004b31cf5152fffce49ebed6e4bb904d60d3e2be75438c0e4f65dcf: Status 404 returned error can't find the container with id 64d60756d004b31cf5152fffce49ebed6e4bb904d60d3e2be75438c0e4f65dcf Jun 03 15:56:05.448422 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:05.448384 2582 generic.go:358] "Generic (PLEG): container finished" podID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerID="ab1ed73969313fb1d80a8254161bc666d355538e9ec7fb549a0c90373027f132" exitCode=0 Jun 03 15:56:05.448601 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:05.448433 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" event={"ID":"7403af54-7880-429f-8d2f-7dbaf01fc599","Type":"ContainerDied","Data":"ab1ed73969313fb1d80a8254161bc666d355538e9ec7fb549a0c90373027f132"} Jun 03 15:56:05.448601 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:05.448467 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" event={"ID":"7403af54-7880-429f-8d2f-7dbaf01fc599","Type":"ContainerStarted","Data":"64d60756d004b31cf5152fffce49ebed6e4bb904d60d3e2be75438c0e4f65dcf"} Jun 03 15:56:06.458474 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:06.458442 2582 generic.go:358] "Generic (PLEG): container finished" podID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerID="5867a69ac07fc6ed059a3894564586db7d62c454033817231774e48d9338b82d" exitCode=0 Jun 03 15:56:06.458474 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:06.458477 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" event={"ID":"7403af54-7880-429f-8d2f-7dbaf01fc599","Type":"ContainerDied","Data":"5867a69ac07fc6ed059a3894564586db7d62c454033817231774e48d9338b82d"} Jun 03 15:56:07.463350 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:07.463308 2582 generic.go:358] "Generic (PLEG): container finished" podID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerID="d61c2e5390400265372bec4859688f218bec2af53ca724f16da8f03d6f87a883" exitCode=0 Jun 03 15:56:07.463727 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:07.463397 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" event={"ID":"7403af54-7880-429f-8d2f-7dbaf01fc599","Type":"ContainerDied","Data":"d61c2e5390400265372bec4859688f218bec2af53ca724f16da8f03d6f87a883"} Jun 03 15:56:08.593825 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.593794 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:08.676995 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.676960 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-bundle\") pod \"7403af54-7880-429f-8d2f-7dbaf01fc599\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " Jun 03 15:56:08.677151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.677044 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-util\") pod \"7403af54-7880-429f-8d2f-7dbaf01fc599\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " Jun 03 15:56:08.677151 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.677072 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk4dd\" (UniqueName: \"kubernetes.io/projected/7403af54-7880-429f-8d2f-7dbaf01fc599-kube-api-access-gk4dd\") pod \"7403af54-7880-429f-8d2f-7dbaf01fc599\" (UID: \"7403af54-7880-429f-8d2f-7dbaf01fc599\") " Jun 03 15:56:08.677864 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.677831 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-bundle" (OuterVolumeSpecName: "bundle") pod "7403af54-7880-429f-8d2f-7dbaf01fc599" (UID: "7403af54-7880-429f-8d2f-7dbaf01fc599"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:56:08.679293 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.679253 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7403af54-7880-429f-8d2f-7dbaf01fc599-kube-api-access-gk4dd" (OuterVolumeSpecName: "kube-api-access-gk4dd") pod "7403af54-7880-429f-8d2f-7dbaf01fc599" (UID: "7403af54-7880-429f-8d2f-7dbaf01fc599"). InnerVolumeSpecName "kube-api-access-gk4dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:56:08.682801 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.682770 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-util" (OuterVolumeSpecName: "util") pod "7403af54-7880-429f-8d2f-7dbaf01fc599" (UID: "7403af54-7880-429f-8d2f-7dbaf01fc599"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:56:08.777977 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.777944 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:08.777977 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.777971 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7403af54-7880-429f-8d2f-7dbaf01fc599-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:08.777977 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:08.777980 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk4dd\" (UniqueName: \"kubernetes.io/projected/7403af54-7880-429f-8d2f-7dbaf01fc599-kube-api-access-gk4dd\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:09.471361 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:09.471326 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" event={"ID":"7403af54-7880-429f-8d2f-7dbaf01fc599","Type":"ContainerDied","Data":"64d60756d004b31cf5152fffce49ebed6e4bb904d60d3e2be75438c0e4f65dcf"} Jun 03 15:56:09.471361 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:09.471346 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvhgdd" Jun 03 15:56:09.471361 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:09.471359 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64d60756d004b31cf5152fffce49ebed6e4bb904d60d3e2be75438c0e4f65dcf" Jun 03 15:56:18.270877 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.270832 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k"] Jun 03 15:56:18.271496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.271289 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerName="util" Jun 03 15:56:18.271496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.271308 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerName="util" Jun 03 15:56:18.271496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.271324 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerName="pull" Jun 03 15:56:18.271496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.271333 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerName="pull" Jun 03 15:56:18.271496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.271341 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerName="extract" Jun 03 15:56:18.271496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.271351 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerName="extract" Jun 03 15:56:18.271496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.271441 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="7403af54-7880-429f-8d2f-7dbaf01fc599" containerName="extract" Jun 03 15:56:18.273456 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.273435 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.281075 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.281055 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 15:56:18.281288 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.281250 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gqrbj\"" Jun 03 15:56:18.294314 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.294293 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 15:56:18.294500 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.294488 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 15:56:18.294540 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.294527 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 15:56:18.313500 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.313466 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k"] Jun 03 15:56:18.359667 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.359625 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzjkd\" (UniqueName: \"kubernetes.io/projected/e1d47d11-032d-40b1-8842-593dfab05cdf-kube-api-access-mzjkd\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.359836 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.359679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1d47d11-032d-40b1-8842-593dfab05cdf-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.359836 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.359740 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1d47d11-032d-40b1-8842-593dfab05cdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.359836 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.359809 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1d47d11-032d-40b1-8842-593dfab05cdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.359954 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.359848 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1d47d11-032d-40b1-8842-593dfab05cdf-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.460431 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.460340 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1d47d11-032d-40b1-8842-593dfab05cdf-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.460431 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.460396 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1d47d11-032d-40b1-8842-593dfab05cdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.460655 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.460433 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1d47d11-032d-40b1-8842-593dfab05cdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.460655 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.460464 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1d47d11-032d-40b1-8842-593dfab05cdf-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.460769 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.460720 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzjkd\" (UniqueName: \"kubernetes.io/projected/e1d47d11-032d-40b1-8842-593dfab05cdf-kube-api-access-mzjkd\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.460888 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.460854 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1d47d11-032d-40b1-8842-593dfab05cdf-manifests\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.462854 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.462832 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1d47d11-032d-40b1-8842-593dfab05cdf-tmp\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.462989 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.462972 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1d47d11-032d-40b1-8842-593dfab05cdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.463169 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.463148 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1d47d11-032d-40b1-8842-593dfab05cdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.475761 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.475724 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzjkd\" (UniqueName: \"kubernetes.io/projected/e1d47d11-032d-40b1-8842-593dfab05cdf-kube-api-access-mzjkd\") pod \"opendatahub-operator-controller-manager-58656688f4-mnf4k\" (UID: \"e1d47d11-032d-40b1-8842-593dfab05cdf\") " pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.584064 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.583977 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:18.725338 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:18.724829 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k"] Jun 03 15:56:18.728248 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:56:18.728216 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d47d11_032d_40b1_8842_593dfab05cdf.slice/crio-23815609da81b59bbe914749d072090f54d8e55538fe8887184d8dc9db2118c8 WatchSource:0}: Error finding container 23815609da81b59bbe914749d072090f54d8e55538fe8887184d8dc9db2118c8: Status 404 returned error can't find the container with id 23815609da81b59bbe914749d072090f54d8e55538fe8887184d8dc9db2118c8 Jun 03 15:56:19.507938 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:19.507886 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" event={"ID":"e1d47d11-032d-40b1-8842-593dfab05cdf","Type":"ContainerStarted","Data":"23815609da81b59bbe914749d072090f54d8e55538fe8887184d8dc9db2118c8"} Jun 03 15:56:22.519203 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:22.519166 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" event={"ID":"e1d47d11-032d-40b1-8842-593dfab05cdf","Type":"ContainerStarted","Data":"5be6aad424afbef6f9d357647be6a8bda880841b2dd1ab3de00ea8eb4546ac5f"} Jun 03 15:56:23.523746 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:23.523709 2582 generic.go:358] "Generic (PLEG): container finished" podID="e1d47d11-032d-40b1-8842-593dfab05cdf" containerID="5be6aad424afbef6f9d357647be6a8bda880841b2dd1ab3de00ea8eb4546ac5f" exitCode=0 Jun 03 15:56:23.524160 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:23.523774 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" event={"ID":"e1d47d11-032d-40b1-8842-593dfab05cdf","Type":"ContainerDied","Data":"5be6aad424afbef6f9d357647be6a8bda880841b2dd1ab3de00ea8eb4546ac5f"} Jun 03 15:56:24.528452 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:24.528415 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" event={"ID":"e1d47d11-032d-40b1-8842-593dfab05cdf","Type":"ContainerStarted","Data":"549d0179f77d5dc85e58d440bd4fd00cefd7c1ce735a258155490e6169c19ea3"} Jun 03 15:56:24.528851 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:24.528533 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:24.558797 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:24.558745 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" podStartSLOduration=1.271093744 podStartE2EDuration="6.558732019s" podCreationTimestamp="2026-06-03 15:56:18 +0000 UTC" firstStartedPulling="2026-06-03 15:56:18.729576984 +0000 UTC m=+435.325336655" lastFinishedPulling="2026-06-03 15:56:24.017215255 +0000 UTC m=+440.612974930" observedRunningTime="2026-06-03 15:56:24.557207664 +0000 UTC m=+441.152967358" watchObservedRunningTime="2026-06-03 15:56:24.558732019 +0000 UTC m=+441.154491713" Jun 03 15:56:35.534247 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:35.534213 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58656688f4-mnf4k" Jun 03 15:56:36.734841 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.734803 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l"] Jun 03 15:56:36.741197 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.741174 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.748719 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.748698 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 15:56:36.748719 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.748699 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9g8cm\"" Jun 03 15:56:36.748900 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.748699 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 15:56:36.748900 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.748703 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 15:56:36.802849 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.802814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9112736-779a-4c8c-9d12-21af4da88953-metrics-cert\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.802849 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.802854 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlgpb\" (UniqueName: \"kubernetes.io/projected/e9112736-779a-4c8c-9d12-21af4da88953-kube-api-access-wlgpb\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.803051 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.802880 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9112736-779a-4c8c-9d12-21af4da88953-manager-config\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.803051 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.802969 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9112736-779a-4c8c-9d12-21af4da88953-cert\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.847885 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.847846 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l"] Jun 03 15:56:36.903420 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.903381 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9112736-779a-4c8c-9d12-21af4da88953-cert\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.903626 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.903437 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9112736-779a-4c8c-9d12-21af4da88953-metrics-cert\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.903626 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.903469 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlgpb\" (UniqueName: \"kubernetes.io/projected/e9112736-779a-4c8c-9d12-21af4da88953-kube-api-access-wlgpb\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.903626 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.903498 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9112736-779a-4c8c-9d12-21af4da88953-manager-config\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.904133 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.904109 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9112736-779a-4c8c-9d12-21af4da88953-manager-config\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.906252 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.906228 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9112736-779a-4c8c-9d12-21af4da88953-cert\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.906829 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.906810 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9112736-779a-4c8c-9d12-21af4da88953-metrics-cert\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:36.915334 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:36.915312 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlgpb\" (UniqueName: \"kubernetes.io/projected/e9112736-779a-4c8c-9d12-21af4da88953-kube-api-access-wlgpb\") pod \"lws-controller-manager-98789b7d5-llw4l\" (UID: \"e9112736-779a-4c8c-9d12-21af4da88953\") " pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:37.050317 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:37.050219 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:37.220364 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:37.220163 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l"] Jun 03 15:56:37.222997 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:56:37.222965 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9112736_779a_4c8c_9d12_21af4da88953.slice/crio-5ad45774f8c30a043dc7b51c92f48d2107e949b9b24ee3d9ca1bdd25f4114e27 WatchSource:0}: Error finding container 5ad45774f8c30a043dc7b51c92f48d2107e949b9b24ee3d9ca1bdd25f4114e27: Status 404 returned error can't find the container with id 5ad45774f8c30a043dc7b51c92f48d2107e949b9b24ee3d9ca1bdd25f4114e27 Jun 03 15:56:37.572533 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:37.572489 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" event={"ID":"e9112736-779a-4c8c-9d12-21af4da88953","Type":"ContainerStarted","Data":"5ad45774f8c30a043dc7b51c92f48d2107e949b9b24ee3d9ca1bdd25f4114e27"} Jun 03 15:56:38.036634 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.036594 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg"] Jun 03 15:56:38.041513 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.041490 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.045675 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.045505 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-k2qbd\"" Jun 03 15:56:38.045675 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.045546 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 15:56:38.046952 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.046932 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 15:56:38.047235 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.047209 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 15:56:38.047377 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.047223 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 15:56:38.059580 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.059552 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg"] Jun 03 15:56:38.113968 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.113934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67494cdc-037a-44d3-b5f7-81d917021dae-tls-certs\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.114153 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.113985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrsz\" (UniqueName: \"kubernetes.io/projected/67494cdc-037a-44d3-b5f7-81d917021dae-kube-api-access-sxrsz\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.114153 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.114140 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67494cdc-037a-44d3-b5f7-81d917021dae-tmp\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.171925 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.171894 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z"] Jun 03 15:56:38.175308 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.175283 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.180601 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.180487 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:56:38.180601 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.180552 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:56:38.180814 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.180707 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-flvl5\"" Jun 03 15:56:38.190113 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.190087 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z"] Jun 03 15:56:38.215314 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.215278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.215477 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.215339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.215477 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.215371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chn5p\" (UniqueName: \"kubernetes.io/projected/2a58420a-b896-4c88-b15b-24ddeb279d73-kube-api-access-chn5p\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.215477 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.215419 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67494cdc-037a-44d3-b5f7-81d917021dae-tmp\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.215477 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.215452 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67494cdc-037a-44d3-b5f7-81d917021dae-tls-certs\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.215667 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.215489 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrsz\" (UniqueName: \"kubernetes.io/projected/67494cdc-037a-44d3-b5f7-81d917021dae-kube-api-access-sxrsz\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.218022 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.217996 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67494cdc-037a-44d3-b5f7-81d917021dae-tmp\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.218838 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.218813 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67494cdc-037a-44d3-b5f7-81d917021dae-tls-certs\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.244241 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.244196 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrsz\" (UniqueName: \"kubernetes.io/projected/67494cdc-037a-44d3-b5f7-81d917021dae-kube-api-access-sxrsz\") pod \"kube-auth-proxy-685b7b64cc-cvfwg\" (UID: \"67494cdc-037a-44d3-b5f7-81d917021dae\") " pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.315882 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.315805 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.315882 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.315853 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chn5p\" (UniqueName: \"kubernetes.io/projected/2a58420a-b896-4c88-b15b-24ddeb279d73-kube-api-access-chn5p\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.316119 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.315951 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.316181 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.316152 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.316303 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.316284 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.352405 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.352375 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chn5p\" (UniqueName: \"kubernetes.io/projected/2a58420a-b896-4c88-b15b-24ddeb279d73-kube-api-access-chn5p\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.356095 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.356071 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" Jun 03 15:56:38.486202 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.486160 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:38.862640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.862613 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg"] Jun 03 15:56:38.864248 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:56:38.864219 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67494cdc_037a_44d3_b5f7_81d917021dae.slice/crio-e39e6deb9923e177c82ee3f7e6e706f85b42a7f952ec255f35e310f1c2c69b82 WatchSource:0}: Error finding container e39e6deb9923e177c82ee3f7e6e706f85b42a7f952ec255f35e310f1c2c69b82: Status 404 returned error can't find the container with id e39e6deb9923e177c82ee3f7e6e706f85b42a7f952ec255f35e310f1c2c69b82 Jun 03 15:56:38.869241 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:38.869219 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z"] Jun 03 15:56:38.877674 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:56:38.877630 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a58420a_b896_4c88_b15b_24ddeb279d73.slice/crio-b757fba95202b43a4f344ad7447fa8246d1c8ce8535f17d3474e3d6d170790d7 WatchSource:0}: Error finding container b757fba95202b43a4f344ad7447fa8246d1c8ce8535f17d3474e3d6d170790d7: Status 404 returned error can't find the container with id b757fba95202b43a4f344ad7447fa8246d1c8ce8535f17d3474e3d6d170790d7 Jun 03 15:56:39.582513 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:39.582461 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" event={"ID":"e9112736-779a-4c8c-9d12-21af4da88953","Type":"ContainerStarted","Data":"4219f2d8c9585b1b1236308f2ed42e6acbb241f468bae92af5f69be80ff713e1"} Jun 03 15:56:39.583002 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:39.582593 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:39.583926 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:39.583899 2582 generic.go:358] "Generic (PLEG): container finished" podID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerID="5523937d8390a82873362cd71b69c17b95215b0216df438be0f86055bfc9914a" exitCode=0 Jun 03 15:56:39.584054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:39.583974 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" event={"ID":"2a58420a-b896-4c88-b15b-24ddeb279d73","Type":"ContainerDied","Data":"5523937d8390a82873362cd71b69c17b95215b0216df438be0f86055bfc9914a"} Jun 03 15:56:39.584054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:39.583997 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" event={"ID":"2a58420a-b896-4c88-b15b-24ddeb279d73","Type":"ContainerStarted","Data":"b757fba95202b43a4f344ad7447fa8246d1c8ce8535f17d3474e3d6d170790d7"} Jun 03 15:56:39.585186 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:39.585164 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" event={"ID":"67494cdc-037a-44d3-b5f7-81d917021dae","Type":"ContainerStarted","Data":"e39e6deb9923e177c82ee3f7e6e706f85b42a7f952ec255f35e310f1c2c69b82"} Jun 03 15:56:39.630500 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:39.630450 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" podStartSLOduration=2.117717586 podStartE2EDuration="3.630434422s" podCreationTimestamp="2026-06-03 15:56:36 +0000 UTC" firstStartedPulling="2026-06-03 15:56:37.224625116 +0000 UTC m=+453.820384788" lastFinishedPulling="2026-06-03 15:56:38.737341947 +0000 UTC m=+455.333101624" observedRunningTime="2026-06-03 15:56:39.62913181 +0000 UTC m=+456.224891506" watchObservedRunningTime="2026-06-03 15:56:39.630434422 +0000 UTC m=+456.226194116" Jun 03 15:56:42.597221 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:42.597186 2582 generic.go:358] "Generic (PLEG): container finished" podID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerID="79ab90ecb187ccac62e69d12c56bda2467547cbd40df408d1f65e1104da82f0a" exitCode=0 Jun 03 15:56:42.597755 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:42.597255 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" event={"ID":"2a58420a-b896-4c88-b15b-24ddeb279d73","Type":"ContainerDied","Data":"79ab90ecb187ccac62e69d12c56bda2467547cbd40df408d1f65e1104da82f0a"} Jun 03 15:56:42.598737 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:42.598706 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" event={"ID":"67494cdc-037a-44d3-b5f7-81d917021dae","Type":"ContainerStarted","Data":"6128b50d1757178b3d5af3131db7901947f729a58b24f8a59253467b8c123e2d"} Jun 03 15:56:42.655791 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:42.655507 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-685b7b64cc-cvfwg" podStartSLOduration=1.911954786 podStartE2EDuration="4.655488704s" podCreationTimestamp="2026-06-03 15:56:38 +0000 UTC" firstStartedPulling="2026-06-03 15:56:38.86623722 +0000 UTC m=+455.461996894" lastFinishedPulling="2026-06-03 15:56:41.609771135 +0000 UTC m=+458.205530812" observedRunningTime="2026-06-03 15:56:42.65353076 +0000 UTC m=+459.249290453" watchObservedRunningTime="2026-06-03 15:56:42.655488704 +0000 UTC m=+459.251248402" Jun 03 15:56:43.604586 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:43.604545 2582 generic.go:358] "Generic (PLEG): container finished" podID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerID="703887aa60305bcadd2e732f61fe51c2e465a36c96922d367db2a96f6d18a97e" exitCode=0 Jun 03 15:56:43.604926 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:43.604632 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" event={"ID":"2a58420a-b896-4c88-b15b-24ddeb279d73","Type":"ContainerDied","Data":"703887aa60305bcadd2e732f61fe51c2e465a36c96922d367db2a96f6d18a97e"} Jun 03 15:56:44.743518 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.743485 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:44.876291 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.876184 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chn5p\" (UniqueName: \"kubernetes.io/projected/2a58420a-b896-4c88-b15b-24ddeb279d73-kube-api-access-chn5p\") pod \"2a58420a-b896-4c88-b15b-24ddeb279d73\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " Jun 03 15:56:44.876291 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.876232 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-util\") pod \"2a58420a-b896-4c88-b15b-24ddeb279d73\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " Jun 03 15:56:44.876512 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.876314 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-bundle\") pod \"2a58420a-b896-4c88-b15b-24ddeb279d73\" (UID: \"2a58420a-b896-4c88-b15b-24ddeb279d73\") " Jun 03 15:56:44.877162 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.877133 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-bundle" (OuterVolumeSpecName: "bundle") pod "2a58420a-b896-4c88-b15b-24ddeb279d73" (UID: "2a58420a-b896-4c88-b15b-24ddeb279d73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:56:44.878493 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.878472 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a58420a-b896-4c88-b15b-24ddeb279d73-kube-api-access-chn5p" (OuterVolumeSpecName: "kube-api-access-chn5p") pod "2a58420a-b896-4c88-b15b-24ddeb279d73" (UID: "2a58420a-b896-4c88-b15b-24ddeb279d73"). InnerVolumeSpecName "kube-api-access-chn5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:56:44.880819 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.880782 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-util" (OuterVolumeSpecName: "util") pod "2a58420a-b896-4c88-b15b-24ddeb279d73" (UID: "2a58420a-b896-4c88-b15b-24ddeb279d73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:56:44.976873 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.976834 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chn5p\" (UniqueName: \"kubernetes.io/projected/2a58420a-b896-4c88-b15b-24ddeb279d73-kube-api-access-chn5p\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:44.976873 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.976866 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:44.976873 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:44.976876 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a58420a-b896-4c88-b15b-24ddeb279d73-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:45.613280 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:45.613227 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" Jun 03 15:56:45.613280 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:45.613243 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gjb5z" event={"ID":"2a58420a-b896-4c88-b15b-24ddeb279d73","Type":"ContainerDied","Data":"b757fba95202b43a4f344ad7447fa8246d1c8ce8535f17d3474e3d6d170790d7"} Jun 03 15:56:45.613495 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:45.613292 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b757fba95202b43a4f344ad7447fa8246d1c8ce8535f17d3474e3d6d170790d7" Jun 03 15:56:50.592325 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:50.592295 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-98789b7d5-llw4l" Jun 03 15:56:52.230088 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230050 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf"] Jun 03 15:56:52.230640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230384 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerName="extract" Jun 03 15:56:52.230640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230397 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerName="extract" Jun 03 15:56:52.230640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230411 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerName="util" Jun 03 15:56:52.230640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230416 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerName="util" Jun 03 15:56:52.230640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230422 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerName="pull" Jun 03 15:56:52.230640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230427 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerName="pull" Jun 03 15:56:52.230640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.230482 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a58420a-b896-4c88-b15b-24ddeb279d73" containerName="extract" Jun 03 15:56:52.237601 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.237581 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.241126 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.241106 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:56:52.242584 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.242562 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:56:52.242692 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.242587 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-flvl5\"" Jun 03 15:56:52.249898 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.249870 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf"] Jun 03 15:56:52.341166 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.341129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.341398 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.341181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8l4\" (UniqueName: \"kubernetes.io/projected/812e0788-2b01-4b36-a89f-5fd990a54644-kube-api-access-wp8l4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.341398 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.341249 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.442422 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.442379 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8l4\" (UniqueName: \"kubernetes.io/projected/812e0788-2b01-4b36-a89f-5fd990a54644-kube-api-access-wp8l4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.442594 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.442449 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.442594 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.442486 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.442837 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.442820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.442895 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.442876 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.556564 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.556484 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8l4\" (UniqueName: \"kubernetes.io/projected/812e0788-2b01-4b36-a89f-5fd990a54644-kube-api-access-wp8l4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:52.848676 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:52.848587 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:53.015622 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:53.015530 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf"] Jun 03 15:56:53.019121 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:56:53.019087 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812e0788_2b01_4b36_a89f_5fd990a54644.slice/crio-a8d6042c1d37a9dc78641ba6ce08bb97f8840939ec48608a769d4526f208376f WatchSource:0}: Error finding container a8d6042c1d37a9dc78641ba6ce08bb97f8840939ec48608a769d4526f208376f: Status 404 returned error can't find the container with id a8d6042c1d37a9dc78641ba6ce08bb97f8840939ec48608a769d4526f208376f Jun 03 15:56:53.646598 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:53.646561 2582 generic.go:358] "Generic (PLEG): container finished" podID="812e0788-2b01-4b36-a89f-5fd990a54644" containerID="8517273f4810db81bbec32a8930411033c92d07195a803a163471c08f15aafd2" exitCode=0 Jun 03 15:56:53.646962 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:53.646617 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" event={"ID":"812e0788-2b01-4b36-a89f-5fd990a54644","Type":"ContainerDied","Data":"8517273f4810db81bbec32a8930411033c92d07195a803a163471c08f15aafd2"} Jun 03 15:56:53.646962 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:53.646639 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" event={"ID":"812e0788-2b01-4b36-a89f-5fd990a54644","Type":"ContainerStarted","Data":"a8d6042c1d37a9dc78641ba6ce08bb97f8840939ec48608a769d4526f208376f"} Jun 03 15:56:54.651215 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:54.651124 2582 generic.go:358] "Generic (PLEG): container finished" podID="812e0788-2b01-4b36-a89f-5fd990a54644" containerID="95537583e322b8d088e9602c1b271274096d33de143d984fe26f1da9ae2717bc" exitCode=0 Jun 03 15:56:54.651215 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:54.651171 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" event={"ID":"812e0788-2b01-4b36-a89f-5fd990a54644","Type":"ContainerDied","Data":"95537583e322b8d088e9602c1b271274096d33de143d984fe26f1da9ae2717bc"} Jun 03 15:56:55.656736 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:55.656702 2582 generic.go:358] "Generic (PLEG): container finished" podID="812e0788-2b01-4b36-a89f-5fd990a54644" containerID="fe3d4703199ca549b61f581baddaf3c4e703667403c207dfc381b34b740f1ef4" exitCode=0 Jun 03 15:56:55.657177 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:55.656790 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" event={"ID":"812e0788-2b01-4b36-a89f-5fd990a54644","Type":"ContainerDied","Data":"fe3d4703199ca549b61f581baddaf3c4e703667403c207dfc381b34b740f1ef4"} Jun 03 15:56:56.782968 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.782940 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:56.883807 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.883775 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-bundle\") pod \"812e0788-2b01-4b36-a89f-5fd990a54644\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " Jun 03 15:56:56.883807 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.883814 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp8l4\" (UniqueName: \"kubernetes.io/projected/812e0788-2b01-4b36-a89f-5fd990a54644-kube-api-access-wp8l4\") pod \"812e0788-2b01-4b36-a89f-5fd990a54644\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " Jun 03 15:56:56.884048 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.883853 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-util\") pod \"812e0788-2b01-4b36-a89f-5fd990a54644\" (UID: \"812e0788-2b01-4b36-a89f-5fd990a54644\") " Jun 03 15:56:56.885037 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.885006 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-bundle" (OuterVolumeSpecName: "bundle") pod "812e0788-2b01-4b36-a89f-5fd990a54644" (UID: "812e0788-2b01-4b36-a89f-5fd990a54644"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:56:56.886178 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.886155 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812e0788-2b01-4b36-a89f-5fd990a54644-kube-api-access-wp8l4" (OuterVolumeSpecName: "kube-api-access-wp8l4") pod "812e0788-2b01-4b36-a89f-5fd990a54644" (UID: "812e0788-2b01-4b36-a89f-5fd990a54644"). InnerVolumeSpecName "kube-api-access-wp8l4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:56:56.889329 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.889306 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-util" (OuterVolumeSpecName: "util") pod "812e0788-2b01-4b36-a89f-5fd990a54644" (UID: "812e0788-2b01-4b36-a89f-5fd990a54644"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:56:56.984606 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.984573 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:56.984606 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.984603 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp8l4\" (UniqueName: \"kubernetes.io/projected/812e0788-2b01-4b36-a89f-5fd990a54644-kube-api-access-wp8l4\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:56.984606 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:56.984612 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812e0788-2b01-4b36-a89f-5fd990a54644-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:56:57.664965 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:57.664936 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" Jun 03 15:56:57.665152 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:57.664926 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762agmxjf" event={"ID":"812e0788-2b01-4b36-a89f-5fd990a54644","Type":"ContainerDied","Data":"a8d6042c1d37a9dc78641ba6ce08bb97f8840939ec48608a769d4526f208376f"} Jun 03 15:56:57.665152 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:56:57.665057 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8d6042c1d37a9dc78641ba6ce08bb97f8840939ec48608a769d4526f208376f" Jun 03 15:57:20.322992 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.322959 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59ff78b6df-llznx"] Jun 03 15:57:20.323608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.323460 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812e0788-2b01-4b36-a89f-5fd990a54644" containerName="extract" Jun 03 15:57:20.323608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.323481 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="812e0788-2b01-4b36-a89f-5fd990a54644" containerName="extract" Jun 03 15:57:20.323608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.323520 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812e0788-2b01-4b36-a89f-5fd990a54644" containerName="util" Jun 03 15:57:20.323608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.323529 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="812e0788-2b01-4b36-a89f-5fd990a54644" containerName="util" Jun 03 15:57:20.323608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.323540 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812e0788-2b01-4b36-a89f-5fd990a54644" containerName="pull" Jun 03 15:57:20.323608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.323549 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="812e0788-2b01-4b36-a89f-5fd990a54644" containerName="pull" Jun 03 15:57:20.323909 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.323620 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="812e0788-2b01-4b36-a89f-5fd990a54644" containerName="extract" Jun 03 15:57:20.326785 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.326765 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.338476 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.338451 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59ff78b6df-llznx"] Jun 03 15:57:20.373852 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.373815 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-trusted-ca-bundle\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.373852 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.373855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-service-ca\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.374054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.373891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-oauth-config\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.374054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.373935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-serving-cert\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.374054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.373990 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-config\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.374054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.374017 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-oauth-serving-cert\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.374179 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.374054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28fc\" (UniqueName: \"kubernetes.io/projected/f89716bb-e3dd-4c0f-9345-b8cc47a75346-kube-api-access-q28fc\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.474984 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.474921 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-trusted-ca-bundle\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.474984 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.474989 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-service-ca\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.475251 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.475023 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-oauth-config\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.475251 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.475076 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-serving-cert\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.475251 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.475116 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-config\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.475251 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.475148 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-oauth-serving-cert\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.475251 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.475180 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q28fc\" (UniqueName: \"kubernetes.io/projected/f89716bb-e3dd-4c0f-9345-b8cc47a75346-kube-api-access-q28fc\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.475874 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.475805 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-service-ca\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.476105 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.475965 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-oauth-serving-cert\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.476105 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.476029 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-config\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.476221 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.476173 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f89716bb-e3dd-4c0f-9345-b8cc47a75346-trusted-ca-bundle\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.477789 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.477758 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-oauth-config\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.477928 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.477906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f89716bb-e3dd-4c0f-9345-b8cc47a75346-console-serving-cert\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.486446 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.486418 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28fc\" (UniqueName: \"kubernetes.io/projected/f89716bb-e3dd-4c0f-9345-b8cc47a75346-kube-api-access-q28fc\") pod \"console-59ff78b6df-llznx\" (UID: \"f89716bb-e3dd-4c0f-9345-b8cc47a75346\") " pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.636472 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.636366 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:20.773519 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:20.773491 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59ff78b6df-llznx"] Jun 03 15:57:20.776065 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:57:20.776029 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89716bb_e3dd_4c0f_9345_b8cc47a75346.slice/crio-9ebcc0090c051af17f1831424d52839e5d2f9903266a5d5f30fdb2a2a8769ec4 WatchSource:0}: Error finding container 9ebcc0090c051af17f1831424d52839e5d2f9903266a5d5f30fdb2a2a8769ec4: Status 404 returned error can't find the container with id 9ebcc0090c051af17f1831424d52839e5d2f9903266a5d5f30fdb2a2a8769ec4 Jun 03 15:57:21.747040 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:21.747000 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59ff78b6df-llznx" event={"ID":"f89716bb-e3dd-4c0f-9345-b8cc47a75346","Type":"ContainerStarted","Data":"bc0527b57c02399acb6d997a652d093f56caa783d06b81724206391ac6608e2f"} Jun 03 15:57:21.747040 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:21.747036 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59ff78b6df-llznx" event={"ID":"f89716bb-e3dd-4c0f-9345-b8cc47a75346","Type":"ContainerStarted","Data":"9ebcc0090c051af17f1831424d52839e5d2f9903266a5d5f30fdb2a2a8769ec4"} Jun 03 15:57:21.771925 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:21.771870 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59ff78b6df-llznx" podStartSLOduration=1.771855274 podStartE2EDuration="1.771855274s" podCreationTimestamp="2026-06-03 15:57:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:57:21.770029322 +0000 UTC m=+498.365789015" watchObservedRunningTime="2026-06-03 15:57:21.771855274 +0000 UTC m=+498.367614968" Jun 03 15:57:30.636752 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:30.636708 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:30.636752 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:30.636755 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:30.641427 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:30.641395 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:30.780409 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:30.780373 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59ff78b6df-llznx" Jun 03 15:57:30.857357 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:30.857312 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585c9d5b77-njbrp"] Jun 03 15:57:54.391820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.391724 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz"] Jun 03 15:57:54.395564 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.395541 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.399363 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.399343 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:57:54.400776 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.400758 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:57:54.400901 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.400777 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jhv64\"" Jun 03 15:57:54.406543 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.406518 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz"] Jun 03 15:57:54.558749 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.558712 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.558918 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.558757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.558918 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.558778 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fmrv\" (UniqueName: \"kubernetes.io/projected/6c9697ce-659a-475a-9909-d011f6cd5e94-kube-api-access-2fmrv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.659863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.659765 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.659863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.659827 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.659863 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.659864 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fmrv\" (UniqueName: \"kubernetes.io/projected/6c9697ce-659a-475a-9909-d011f6cd5e94-kube-api-access-2fmrv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.660198 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.660175 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.660297 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.660203 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.672599 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.672568 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fmrv\" (UniqueName: \"kubernetes.io/projected/6c9697ce-659a-475a-9909-d011f6cd5e94-kube-api-access-2fmrv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.706561 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.706527 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:54.845095 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.842015 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz"] Jun 03 15:57:54.857361 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:54.857335 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" event={"ID":"6c9697ce-659a-475a-9909-d011f6cd5e94","Type":"ContainerStarted","Data":"96f239834e2bfd20c8aeb1e97a39b55fbff7feecc3fbce7dd167f53d0662c5ee"} Jun 03 15:57:55.218025 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.217945 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt"] Jun 03 15:57:55.221380 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.221365 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.256619 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.256588 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt"] Jun 03 15:57:55.366818 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.366781 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.367014 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.366862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.367014 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.366905 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmgzh\" (UniqueName: \"kubernetes.io/projected/9593a94d-6c95-46a7-aace-54c010279586-kube-api-access-xmgzh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.468147 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.468051 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.468147 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.468104 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmgzh\" (UniqueName: \"kubernetes.io/projected/9593a94d-6c95-46a7-aace-54c010279586-kube-api-access-xmgzh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.468147 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.468147 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.468708 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.468539 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.468708 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.468571 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.486539 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.486508 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmgzh\" (UniqueName: \"kubernetes.io/projected/9593a94d-6c95-46a7-aace-54c010279586-kube-api-access-xmgzh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.530111 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.530078 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:55.588563 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.588531 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf"] Jun 03 15:57:55.593399 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.593376 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.603757 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.603729 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf"] Jun 03 15:57:55.668968 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.668947 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt"] Jun 03 15:57:55.669498 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.669438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.669551 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.669534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2tz\" (UniqueName: \"kubernetes.io/projected/114198f4-4d42-455d-943d-2e4e0e75412a-kube-api-access-pj2tz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.669629 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.669596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.671677 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:57:55.671654 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9593a94d_6c95_46a7_aace_54c010279586.slice/crio-18da31360eb179061f4853b81840c43618b612bb1907da0bfd494bbb854acf01 WatchSource:0}: Error finding container 18da31360eb179061f4853b81840c43618b612bb1907da0bfd494bbb854acf01: Status 404 returned error can't find the container with id 18da31360eb179061f4853b81840c43618b612bb1907da0bfd494bbb854acf01 Jun 03 15:57:55.770787 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.770754 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.770911 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.770821 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2tz\" (UniqueName: \"kubernetes.io/projected/114198f4-4d42-455d-943d-2e4e0e75412a-kube-api-access-pj2tz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.770911 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.770892 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.771229 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.771208 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.771322 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.771233 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.782535 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.782509 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2tz\" (UniqueName: \"kubernetes.io/projected/114198f4-4d42-455d-943d-2e4e0e75412a-kube-api-access-pj2tz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.861871 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.861835 2582 generic.go:358] "Generic (PLEG): container finished" podID="9593a94d-6c95-46a7-aace-54c010279586" containerID="6dce1f7d1675765304c3cef3503c2acee8c2da9d5320b761bf5b436eb3ea36c0" exitCode=0 Jun 03 15:57:55.862064 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.861933 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" event={"ID":"9593a94d-6c95-46a7-aace-54c010279586","Type":"ContainerDied","Data":"6dce1f7d1675765304c3cef3503c2acee8c2da9d5320b761bf5b436eb3ea36c0"} Jun 03 15:57:55.862064 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.861975 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" event={"ID":"9593a94d-6c95-46a7-aace-54c010279586","Type":"ContainerStarted","Data":"18da31360eb179061f4853b81840c43618b612bb1907da0bfd494bbb854acf01"} Jun 03 15:57:55.863316 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.863296 2582 generic.go:358] "Generic (PLEG): container finished" podID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerID="08421b2ad2047fb7350e4e4b56aad35fc49a65e2289a9b6c6e56ec7afa7df352" exitCode=0 Jun 03 15:57:55.863426 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.863398 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" event={"ID":"6c9697ce-659a-475a-9909-d011f6cd5e94","Type":"ContainerDied","Data":"08421b2ad2047fb7350e4e4b56aad35fc49a65e2289a9b6c6e56ec7afa7df352"} Jun 03 15:57:55.878012 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.877987 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-585c9d5b77-njbrp" podUID="a3aec148-d88e-43a8-929f-f9099d74435f" containerName="console" containerID="cri-o://4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb" gracePeriod=15 Jun 03 15:57:55.902623 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.902599 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:57:55.983558 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.983528 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs"] Jun 03 15:57:55.988702 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.988678 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:55.997821 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:55.997761 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs"] Jun 03 15:57:56.047931 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.047909 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf"] Jun 03 15:57:56.049665 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:57:56.049639 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114198f4_4d42_455d_943d_2e4e0e75412a.slice/crio-898aaf59377bdd788eae756de1fc1855f5ccd1cc6cb99c1bb1fda7aaabc95f76 WatchSource:0}: Error finding container 898aaf59377bdd788eae756de1fc1855f5ccd1cc6cb99c1bb1fda7aaabc95f76: Status 404 returned error can't find the container with id 898aaf59377bdd788eae756de1fc1855f5ccd1cc6cb99c1bb1fda7aaabc95f76 Jun 03 15:57:56.073128 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.073097 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.073232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.073147 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.073232 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.073207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7jql\" (UniqueName: \"kubernetes.io/projected/34ad32ec-9715-4dd0-8b26-f921e58e0322-kube-api-access-x7jql\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.116294 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.116243 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-585c9d5b77-njbrp_a3aec148-d88e-43a8-929f-f9099d74435f/console/0.log" Jun 03 15:57:56.116384 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.116354 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:57:56.174688 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.174661 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.174790 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.174700 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.174790 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.174721 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7jql\" (UniqueName: \"kubernetes.io/projected/34ad32ec-9715-4dd0-8b26-f921e58e0322-kube-api-access-x7jql\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.175083 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.175061 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.175126 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.175072 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.202559 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.202519 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7jql\" (UniqueName: \"kubernetes.io/projected/34ad32ec-9715-4dd0-8b26-f921e58e0322-kube-api-access-x7jql\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.275748 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.275653 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq24c\" (UniqueName: \"kubernetes.io/projected/a3aec148-d88e-43a8-929f-f9099d74435f-kube-api-access-bq24c\") pod \"a3aec148-d88e-43a8-929f-f9099d74435f\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " Jun 03 15:57:56.275748 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.275710 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-service-ca\") pod \"a3aec148-d88e-43a8-929f-f9099d74435f\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " Jun 03 15:57:56.275950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.275756 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-oauth-config\") pod \"a3aec148-d88e-43a8-929f-f9099d74435f\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " Jun 03 15:57:56.275950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.275777 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-serving-cert\") pod \"a3aec148-d88e-43a8-929f-f9099d74435f\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " Jun 03 15:57:56.275950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.275804 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-oauth-serving-cert\") pod \"a3aec148-d88e-43a8-929f-f9099d74435f\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " Jun 03 15:57:56.275950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.275883 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-console-config\") pod \"a3aec148-d88e-43a8-929f-f9099d74435f\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " Jun 03 15:57:56.275950 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.275921 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-trusted-ca-bundle\") pod \"a3aec148-d88e-43a8-929f-f9099d74435f\" (UID: \"a3aec148-d88e-43a8-929f-f9099d74435f\") " Jun 03 15:57:56.276331 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.276291 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-service-ca" (OuterVolumeSpecName: "service-ca") pod "a3aec148-d88e-43a8-929f-f9099d74435f" (UID: "a3aec148-d88e-43a8-929f-f9099d74435f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:57:56.276464 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.276367 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a3aec148-d88e-43a8-929f-f9099d74435f" (UID: "a3aec148-d88e-43a8-929f-f9099d74435f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:57:56.276464 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.276398 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-service-ca\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:56.276464 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.276408 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a3aec148-d88e-43a8-929f-f9099d74435f" (UID: "a3aec148-d88e-43a8-929f-f9099d74435f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:57:56.276464 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.276418 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-console-config" (OuterVolumeSpecName: "console-config") pod "a3aec148-d88e-43a8-929f-f9099d74435f" (UID: "a3aec148-d88e-43a8-929f-f9099d74435f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:57:56.278152 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.278132 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a3aec148-d88e-43a8-929f-f9099d74435f" (UID: "a3aec148-d88e-43a8-929f-f9099d74435f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:57:56.278586 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.278566 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a3aec148-d88e-43a8-929f-f9099d74435f" (UID: "a3aec148-d88e-43a8-929f-f9099d74435f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:57:56.278656 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.278599 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3aec148-d88e-43a8-929f-f9099d74435f-kube-api-access-bq24c" (OuterVolumeSpecName: "kube-api-access-bq24c") pod "a3aec148-d88e-43a8-929f-f9099d74435f" (UID: "a3aec148-d88e-43a8-929f-f9099d74435f"). InnerVolumeSpecName "kube-api-access-bq24c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:57:56.302687 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.302652 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:57:56.377685 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.377645 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-oauth-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:56.377685 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.377681 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3aec148-d88e-43a8-929f-f9099d74435f-console-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:56.377685 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.377691 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-oauth-serving-cert\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:56.377883 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.377701 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-console-config\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:56.377883 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.377710 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3aec148-d88e-43a8-929f-f9099d74435f-trusted-ca-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:56.377883 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.377719 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq24c\" (UniqueName: \"kubernetes.io/projected/a3aec148-d88e-43a8-929f-f9099d74435f-kube-api-access-bq24c\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:56.445317 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.445286 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs"] Jun 03 15:57:56.455587 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:57:56.455557 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ad32ec_9715_4dd0_8b26_f921e58e0322.slice/crio-0555c8ce21b8223fb5e3be8a92828a9967fe027d979a902fc45bb8c51cd93907 WatchSource:0}: Error finding container 0555c8ce21b8223fb5e3be8a92828a9967fe027d979a902fc45bb8c51cd93907: Status 404 returned error can't find the container with id 0555c8ce21b8223fb5e3be8a92828a9967fe027d979a902fc45bb8c51cd93907 Jun 03 15:57:56.868786 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.868750 2582 generic.go:358] "Generic (PLEG): container finished" podID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerID="982b15c789aeeeca5bc1f6a69a65c09e4d38490e565106ae623fa5b692d8015e" exitCode=0 Jun 03 15:57:56.869230 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.868820 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" event={"ID":"34ad32ec-9715-4dd0-8b26-f921e58e0322","Type":"ContainerDied","Data":"982b15c789aeeeca5bc1f6a69a65c09e4d38490e565106ae623fa5b692d8015e"} Jun 03 15:57:56.869230 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.868859 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" event={"ID":"34ad32ec-9715-4dd0-8b26-f921e58e0322","Type":"ContainerStarted","Data":"0555c8ce21b8223fb5e3be8a92828a9967fe027d979a902fc45bb8c51cd93907"} Jun 03 15:57:56.870515 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.870488 2582 generic.go:358] "Generic (PLEG): container finished" podID="9593a94d-6c95-46a7-aace-54c010279586" containerID="7a80d889b6a62276d712cb52300f455dc85c0a328d1efbb062fe85028389164f" exitCode=0 Jun 03 15:57:56.870646 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.870578 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" event={"ID":"9593a94d-6c95-46a7-aace-54c010279586","Type":"ContainerDied","Data":"7a80d889b6a62276d712cb52300f455dc85c0a328d1efbb062fe85028389164f"} Jun 03 15:57:56.871877 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.871861 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-585c9d5b77-njbrp_a3aec148-d88e-43a8-929f-f9099d74435f/console/0.log" Jun 03 15:57:56.871962 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.871891 2582 generic.go:358] "Generic (PLEG): container finished" podID="a3aec148-d88e-43a8-929f-f9099d74435f" containerID="4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb" exitCode=2 Jun 03 15:57:56.872006 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.871957 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9d5b77-njbrp" event={"ID":"a3aec148-d88e-43a8-929f-f9099d74435f","Type":"ContainerDied","Data":"4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb"} Jun 03 15:57:56.872006 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.871973 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585c9d5b77-njbrp" Jun 03 15:57:56.872006 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.871981 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585c9d5b77-njbrp" event={"ID":"a3aec148-d88e-43a8-929f-f9099d74435f","Type":"ContainerDied","Data":"cd2e2f451ab0ee17367df767870bdeac418304297de9fbe8e82850e897ba70eb"} Jun 03 15:57:56.872194 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.872004 2582 scope.go:117] "RemoveContainer" containerID="4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb" Jun 03 15:57:56.874090 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.874067 2582 generic.go:358] "Generic (PLEG): container finished" podID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerID="aee0371b73e4ee6532ffd421a4cae91ddca9ad58cbcc89b1c7c1f61951c46f95" exitCode=0 Jun 03 15:57:56.874199 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.874118 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" event={"ID":"6c9697ce-659a-475a-9909-d011f6cd5e94","Type":"ContainerDied","Data":"aee0371b73e4ee6532ffd421a4cae91ddca9ad58cbcc89b1c7c1f61951c46f95"} Jun 03 15:57:56.875777 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.875665 2582 generic.go:358] "Generic (PLEG): container finished" podID="114198f4-4d42-455d-943d-2e4e0e75412a" containerID="6211b7baa387e4ad03fb209c8366e7cb1cae85cec43fdec3e7d7984ee5ba6e9f" exitCode=0 Jun 03 15:57:56.875777 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.875768 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" event={"ID":"114198f4-4d42-455d-943d-2e4e0e75412a","Type":"ContainerDied","Data":"6211b7baa387e4ad03fb209c8366e7cb1cae85cec43fdec3e7d7984ee5ba6e9f"} Jun 03 15:57:56.875935 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.875790 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" event={"ID":"114198f4-4d42-455d-943d-2e4e0e75412a","Type":"ContainerStarted","Data":"898aaf59377bdd788eae756de1fc1855f5ccd1cc6cb99c1bb1fda7aaabc95f76"} Jun 03 15:57:56.885481 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.885446 2582 scope.go:117] "RemoveContainer" containerID="4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb" Jun 03 15:57:56.885767 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:57:56.885747 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb\": container with ID starting with 4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb not found: ID does not exist" containerID="4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb" Jun 03 15:57:56.885821 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.885779 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb"} err="failed to get container status \"4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb\": rpc error: code = NotFound desc = could not find container \"4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb\": container with ID starting with 4163331fe70a205b1fabe79f0d4fe4cf5f85722f2328d42ec1dbd2eee7c424bb not found: ID does not exist" Jun 03 15:57:56.932050 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.932012 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585c9d5b77-njbrp"] Jun 03 15:57:56.934978 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:56.934949 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-585c9d5b77-njbrp"] Jun 03 15:57:57.882533 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.882504 2582 generic.go:358] "Generic (PLEG): container finished" podID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerID="7e997ceb296bb782c053319735bf4f9c3cb6151f77a13993cb034de20a94761a" exitCode=0 Jun 03 15:57:57.882995 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.882578 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" event={"ID":"6c9697ce-659a-475a-9909-d011f6cd5e94","Type":"ContainerDied","Data":"7e997ceb296bb782c053319735bf4f9c3cb6151f77a13993cb034de20a94761a"} Jun 03 15:57:57.884612 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.884587 2582 generic.go:358] "Generic (PLEG): container finished" podID="114198f4-4d42-455d-943d-2e4e0e75412a" containerID="fb2316e92ef2f7ce30b5d6fa1cf52f4de5334efcf0ef5c466308ccc8f7b059ed" exitCode=0 Jun 03 15:57:57.884711 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.884676 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" event={"ID":"114198f4-4d42-455d-943d-2e4e0e75412a","Type":"ContainerDied","Data":"fb2316e92ef2f7ce30b5d6fa1cf52f4de5334efcf0ef5c466308ccc8f7b059ed"} Jun 03 15:57:57.886297 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.886224 2582 generic.go:358] "Generic (PLEG): container finished" podID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerID="cac0cb3a6eb995d08ba904c733a6d950fc71a1779385b783f792f2c36fbffa61" exitCode=0 Jun 03 15:57:57.886338 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.886327 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" event={"ID":"34ad32ec-9715-4dd0-8b26-f921e58e0322","Type":"ContainerDied","Data":"cac0cb3a6eb995d08ba904c733a6d950fc71a1779385b783f792f2c36fbffa61"} Jun 03 15:57:57.888187 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.888170 2582 generic.go:358] "Generic (PLEG): container finished" podID="9593a94d-6c95-46a7-aace-54c010279586" containerID="d164a33aed644a98438dc63d0c2ce4ad2f089f6c1a0bb78674f02eba2d217781" exitCode=0 Jun 03 15:57:57.888275 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:57.888230 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" event={"ID":"9593a94d-6c95-46a7-aace-54c010279586","Type":"ContainerDied","Data":"d164a33aed644a98438dc63d0c2ce4ad2f089f6c1a0bb78674f02eba2d217781"} Jun 03 15:57:58.037272 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:58.037212 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3aec148-d88e-43a8-929f-f9099d74435f" path="/var/lib/kubelet/pods/a3aec148-d88e-43a8-929f-f9099d74435f/volumes" Jun 03 15:57:58.893399 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:58.893359 2582 generic.go:358] "Generic (PLEG): container finished" podID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerID="f738596a191d02e4063ec67ec8b0a333ae3986139a4d355938260e91812403bc" exitCode=0 Jun 03 15:57:58.893853 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:58.893450 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" event={"ID":"34ad32ec-9715-4dd0-8b26-f921e58e0322","Type":"ContainerDied","Data":"f738596a191d02e4063ec67ec8b0a333ae3986139a4d355938260e91812403bc"} Jun 03 15:57:58.895315 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:58.895287 2582 generic.go:358] "Generic (PLEG): container finished" podID="114198f4-4d42-455d-943d-2e4e0e75412a" containerID="1c07c4f4d7630e91eabc881803bae07ffed0d4bc5f3a336224d7a627511e8a1e" exitCode=0 Jun 03 15:57:58.895423 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:58.895376 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" event={"ID":"114198f4-4d42-455d-943d-2e4e0e75412a","Type":"ContainerDied","Data":"1c07c4f4d7630e91eabc881803bae07ffed0d4bc5f3a336224d7a627511e8a1e"} Jun 03 15:57:59.012613 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.012589 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:59.052110 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.052087 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:59.105826 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.105798 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-bundle\") pod \"9593a94d-6c95-46a7-aace-54c010279586\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " Jun 03 15:57:59.106012 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.105838 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-util\") pod \"9593a94d-6c95-46a7-aace-54c010279586\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " Jun 03 15:57:59.106012 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.105875 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmgzh\" (UniqueName: \"kubernetes.io/projected/9593a94d-6c95-46a7-aace-54c010279586-kube-api-access-xmgzh\") pod \"9593a94d-6c95-46a7-aace-54c010279586\" (UID: \"9593a94d-6c95-46a7-aace-54c010279586\") " Jun 03 15:57:59.106384 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.106358 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-bundle" (OuterVolumeSpecName: "bundle") pod "9593a94d-6c95-46a7-aace-54c010279586" (UID: "9593a94d-6c95-46a7-aace-54c010279586"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:57:59.108188 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.108165 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9593a94d-6c95-46a7-aace-54c010279586-kube-api-access-xmgzh" (OuterVolumeSpecName: "kube-api-access-xmgzh") pod "9593a94d-6c95-46a7-aace-54c010279586" (UID: "9593a94d-6c95-46a7-aace-54c010279586"). InnerVolumeSpecName "kube-api-access-xmgzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:57:59.111320 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.111288 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-util" (OuterVolumeSpecName: "util") pod "9593a94d-6c95-46a7-aace-54c010279586" (UID: "9593a94d-6c95-46a7-aace-54c010279586"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:57:59.207187 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.207100 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-bundle\") pod \"6c9697ce-659a-475a-9909-d011f6cd5e94\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " Jun 03 15:57:59.207389 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.207232 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fmrv\" (UniqueName: \"kubernetes.io/projected/6c9697ce-659a-475a-9909-d011f6cd5e94-kube-api-access-2fmrv\") pod \"6c9697ce-659a-475a-9909-d011f6cd5e94\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " Jun 03 15:57:59.207389 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.207315 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-util\") pod \"6c9697ce-659a-475a-9909-d011f6cd5e94\" (UID: \"6c9697ce-659a-475a-9909-d011f6cd5e94\") " Jun 03 15:57:59.207542 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.207524 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:59.207608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.207547 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9593a94d-6c95-46a7-aace-54c010279586-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:59.207608 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.207562 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmgzh\" (UniqueName: \"kubernetes.io/projected/9593a94d-6c95-46a7-aace-54c010279586-kube-api-access-xmgzh\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:59.207712 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.207689 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-bundle" (OuterVolumeSpecName: "bundle") pod "6c9697ce-659a-475a-9909-d011f6cd5e94" (UID: "6c9697ce-659a-475a-9909-d011f6cd5e94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:57:59.209533 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.209512 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9697ce-659a-475a-9909-d011f6cd5e94-kube-api-access-2fmrv" (OuterVolumeSpecName: "kube-api-access-2fmrv") pod "6c9697ce-659a-475a-9909-d011f6cd5e94" (UID: "6c9697ce-659a-475a-9909-d011f6cd5e94"). InnerVolumeSpecName "kube-api-access-2fmrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:57:59.213005 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.212969 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-util" (OuterVolumeSpecName: "util") pod "6c9697ce-659a-475a-9909-d011f6cd5e94" (UID: "6c9697ce-659a-475a-9909-d011f6cd5e94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:57:59.308622 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.308588 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fmrv\" (UniqueName: \"kubernetes.io/projected/6c9697ce-659a-475a-9909-d011f6cd5e94-kube-api-access-2fmrv\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:59.308622 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.308615 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:59.308622 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.308626 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c9697ce-659a-475a-9909-d011f6cd5e94-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:57:59.900199 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.900166 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" Jun 03 15:57:59.900713 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.900219 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz" event={"ID":"6c9697ce-659a-475a-9909-d011f6cd5e94","Type":"ContainerDied","Data":"96f239834e2bfd20c8aeb1e97a39b55fbff7feecc3fbce7dd167f53d0662c5ee"} Jun 03 15:57:59.900713 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.900253 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96f239834e2bfd20c8aeb1e97a39b55fbff7feecc3fbce7dd167f53d0662c5ee" Jun 03 15:57:59.901932 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.901912 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" Jun 03 15:57:59.902056 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.901943 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt" event={"ID":"9593a94d-6c95-46a7-aace-54c010279586","Type":"ContainerDied","Data":"18da31360eb179061f4853b81840c43618b612bb1907da0bfd494bbb854acf01"} Jun 03 15:57:59.902056 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:57:59.901970 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18da31360eb179061f4853b81840c43618b612bb1907da0bfd494bbb854acf01" Jun 03 15:58:00.036237 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.036214 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:58:00.061991 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.061968 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:58:00.216282 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.216145 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-util\") pod \"34ad32ec-9715-4dd0-8b26-f921e58e0322\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " Jun 03 15:58:00.216282 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.216229 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7jql\" (UniqueName: \"kubernetes.io/projected/34ad32ec-9715-4dd0-8b26-f921e58e0322-kube-api-access-x7jql\") pod \"34ad32ec-9715-4dd0-8b26-f921e58e0322\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " Jun 03 15:58:00.216531 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.216293 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-bundle\") pod \"114198f4-4d42-455d-943d-2e4e0e75412a\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " Jun 03 15:58:00.216531 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.216331 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj2tz\" (UniqueName: \"kubernetes.io/projected/114198f4-4d42-455d-943d-2e4e0e75412a-kube-api-access-pj2tz\") pod \"114198f4-4d42-455d-943d-2e4e0e75412a\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " Jun 03 15:58:00.216531 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.216382 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-util\") pod \"114198f4-4d42-455d-943d-2e4e0e75412a\" (UID: \"114198f4-4d42-455d-943d-2e4e0e75412a\") " Jun 03 15:58:00.216531 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.216415 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-bundle\") pod \"34ad32ec-9715-4dd0-8b26-f921e58e0322\" (UID: \"34ad32ec-9715-4dd0-8b26-f921e58e0322\") " Jun 03 15:58:00.217187 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.216936 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-bundle" (OuterVolumeSpecName: "bundle") pod "34ad32ec-9715-4dd0-8b26-f921e58e0322" (UID: "34ad32ec-9715-4dd0-8b26-f921e58e0322"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:58:00.217370 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.217324 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-bundle" (OuterVolumeSpecName: "bundle") pod "114198f4-4d42-455d-943d-2e4e0e75412a" (UID: "114198f4-4d42-455d-943d-2e4e0e75412a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:58:00.218728 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.218705 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ad32ec-9715-4dd0-8b26-f921e58e0322-kube-api-access-x7jql" (OuterVolumeSpecName: "kube-api-access-x7jql") pod "34ad32ec-9715-4dd0-8b26-f921e58e0322" (UID: "34ad32ec-9715-4dd0-8b26-f921e58e0322"). InnerVolumeSpecName "kube-api-access-x7jql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:58:00.218728 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.218710 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114198f4-4d42-455d-943d-2e4e0e75412a-kube-api-access-pj2tz" (OuterVolumeSpecName: "kube-api-access-pj2tz") pod "114198f4-4d42-455d-943d-2e4e0e75412a" (UID: "114198f4-4d42-455d-943d-2e4e0e75412a"). InnerVolumeSpecName "kube-api-access-pj2tz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:58:00.225206 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.225180 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-util" (OuterVolumeSpecName: "util") pod "34ad32ec-9715-4dd0-8b26-f921e58e0322" (UID: "34ad32ec-9715-4dd0-8b26-f921e58e0322"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:58:00.225366 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.225351 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-util" (OuterVolumeSpecName: "util") pod "114198f4-4d42-455d-943d-2e4e0e75412a" (UID: "114198f4-4d42-455d-943d-2e4e0e75412a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:58:00.317716 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.317661 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7jql\" (UniqueName: \"kubernetes.io/projected/34ad32ec-9715-4dd0-8b26-f921e58e0322-kube-api-access-x7jql\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:00.317716 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.317709 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:00.317716 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.317721 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj2tz\" (UniqueName: \"kubernetes.io/projected/114198f4-4d42-455d-943d-2e4e0e75412a-kube-api-access-pj2tz\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:00.317716 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.317730 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/114198f4-4d42-455d-943d-2e4e0e75412a-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:00.317963 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.317739 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:00.317963 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.317746 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34ad32ec-9715-4dd0-8b26-f921e58e0322-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:00.907794 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.907765 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" Jun 03 15:58:00.907794 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.907781 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf" event={"ID":"114198f4-4d42-455d-943d-2e4e0e75412a","Type":"ContainerDied","Data":"898aaf59377bdd788eae756de1fc1855f5ccd1cc6cb99c1bb1fda7aaabc95f76"} Jun 03 15:58:00.908353 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.907812 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="898aaf59377bdd788eae756de1fc1855f5ccd1cc6cb99c1bb1fda7aaabc95f76" Jun 03 15:58:00.909506 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.909480 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" event={"ID":"34ad32ec-9715-4dd0-8b26-f921e58e0322","Type":"ContainerDied","Data":"0555c8ce21b8223fb5e3be8a92828a9967fe027d979a902fc45bb8c51cd93907"} Jun 03 15:58:00.909506 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.909499 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs" Jun 03 15:58:00.909650 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:00.909503 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0555c8ce21b8223fb5e3be8a92828a9967fe027d979a902fc45bb8c51cd93907" Jun 03 15:58:17.318459 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318418 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4"] Jun 03 15:58:17.318820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318769 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114198f4-4d42-455d-943d-2e4e0e75412a" containerName="pull" Jun 03 15:58:17.318820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318780 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="114198f4-4d42-455d-943d-2e4e0e75412a" containerName="pull" Jun 03 15:58:17.318820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318792 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3aec148-d88e-43a8-929f-f9099d74435f" containerName="console" Jun 03 15:58:17.318820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318798 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3aec148-d88e-43a8-929f-f9099d74435f" containerName="console" Jun 03 15:58:17.318820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318805 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9593a94d-6c95-46a7-aace-54c010279586" containerName="util" Jun 03 15:58:17.318820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318812 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9593a94d-6c95-46a7-aace-54c010279586" containerName="util" Jun 03 15:58:17.318820 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318824 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerName="pull" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318831 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerName="pull" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318847 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerName="util" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318854 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerName="util" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318860 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerName="util" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318866 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerName="util" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318871 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114198f4-4d42-455d-943d-2e4e0e75412a" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318876 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="114198f4-4d42-455d-943d-2e4e0e75412a" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318884 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318889 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318895 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318900 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318905 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerName="pull" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318911 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerName="pull" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318920 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9593a94d-6c95-46a7-aace-54c010279586" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318927 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9593a94d-6c95-46a7-aace-54c010279586" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318935 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114198f4-4d42-455d-943d-2e4e0e75412a" containerName="util" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318939 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="114198f4-4d42-455d-943d-2e4e0e75412a" containerName="util" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318944 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9593a94d-6c95-46a7-aace-54c010279586" containerName="pull" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.318950 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9593a94d-6c95-46a7-aace-54c010279586" containerName="pull" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.319005 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="34ad32ec-9715-4dd0-8b26-f921e58e0322" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.319015 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="a3aec148-d88e-43a8-929f-f9099d74435f" containerName="console" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.319021 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="9593a94d-6c95-46a7-aace-54c010279586" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.319026 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="114198f4-4d42-455d-943d-2e4e0e75412a" containerName="extract" Jun 03 15:58:17.319042 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.319033 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c9697ce-659a-475a-9909-d011f6cd5e94" containerName="extract" Jun 03 15:58:17.323482 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.323461 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.328031 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.328004 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:58:17.328383 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.328368 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cf8ch\"" Jun 03 15:58:17.337848 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.337825 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:58:17.349623 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.349595 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4"] Jun 03 15:58:17.358426 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.358401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.358569 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.358434 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4plpk\" (UniqueName: \"kubernetes.io/projected/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-kube-api-access-4plpk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.459050 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.459014 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.459050 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.459050 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4plpk\" (UniqueName: \"kubernetes.io/projected/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-kube-api-access-4plpk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.459439 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.459417 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.476528 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.476496 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4plpk\" (UniqueName: \"kubernetes.io/projected/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-kube-api-access-4plpk\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.633824 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.633726 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:17.767287 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.767248 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4"] Jun 03 15:58:17.769254 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:58:17.769229 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ac7824_37c0_46e4_9f8e_66ecef3d4e74.slice/crio-9bb25573f88a9086467c197c33597aee28e96de3da4ea21809e7ee85b4770556 WatchSource:0}: Error finding container 9bb25573f88a9086467c197c33597aee28e96de3da4ea21809e7ee85b4770556: Status 404 returned error can't find the container with id 9bb25573f88a9086467c197c33597aee28e96de3da4ea21809e7ee85b4770556 Jun 03 15:58:17.974550 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:17.974519 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" event={"ID":"10ac7824-37c0-46e4-9f8e-66ecef3d4e74","Type":"ContainerStarted","Data":"9bb25573f88a9086467c197c33597aee28e96de3da4ea21809e7ee85b4770556"} Jun 03 15:58:23.997330 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:23.997293 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" event={"ID":"10ac7824-37c0-46e4-9f8e-66ecef3d4e74","Type":"ContainerStarted","Data":"b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559"} Jun 03 15:58:23.997730 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:23.997393 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:24.027971 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:24.027916 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" podStartSLOduration=1.202697852 podStartE2EDuration="7.0279016s" podCreationTimestamp="2026-06-03 15:58:17 +0000 UTC" firstStartedPulling="2026-06-03 15:58:17.77149937 +0000 UTC m=+554.367259042" lastFinishedPulling="2026-06-03 15:58:23.596703114 +0000 UTC m=+560.192462790" observedRunningTime="2026-06-03 15:58:24.026079238 +0000 UTC m=+560.621838934" watchObservedRunningTime="2026-06-03 15:58:24.0279016 +0000 UTC m=+560.623661294" Jun 03 15:58:26.514134 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.514100 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f"] Jun 03 15:58:26.517672 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.517650 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.520578 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.520547 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 15:58:26.520578 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.520568 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 15:58:26.520737 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.520693 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jhv64\"" Jun 03 15:58:26.526236 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.526215 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f"] Jun 03 15:58:26.640674 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.640635 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.640851 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.640681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmws\" (UniqueName: \"kubernetes.io/projected/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-kube-api-access-pqmws\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.640851 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.640716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.741982 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.741945 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmws\" (UniqueName: \"kubernetes.io/projected/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-kube-api-access-pqmws\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.741982 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.741989 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.742189 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.742054 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.742772 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.742746 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.744665 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.744638 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.759496 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.759475 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmws\" (UniqueName: \"kubernetes.io/projected/5b883bf3-725a-4784-8b0c-9a2e5784b9f4-kube-api-access-pqmws\") pod \"kuadrant-console-plugin-6cb54b5c86-qvd8f\" (UID: \"5b883bf3-725a-4784-8b0c-9a2e5784b9f4\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.827640 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.827562 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" Jun 03 15:58:26.958157 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:26.958133 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f"] Jun 03 15:58:26.960063 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:58:26.960034 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b883bf3_725a_4784_8b0c_9a2e5784b9f4.slice/crio-d564ea36220440c4c4481aab36c3837a82d13ae4daa62a12000a5618c1544bcc WatchSource:0}: Error finding container d564ea36220440c4c4481aab36c3837a82d13ae4daa62a12000a5618c1544bcc: Status 404 returned error can't find the container with id d564ea36220440c4c4481aab36c3837a82d13ae4daa62a12000a5618c1544bcc Jun 03 15:58:27.009392 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:27.009360 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" event={"ID":"5b883bf3-725a-4784-8b0c-9a2e5784b9f4","Type":"ContainerStarted","Data":"d564ea36220440c4c4481aab36c3837a82d13ae4daa62a12000a5618c1544bcc"} Jun 03 15:58:35.003387 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:35.003332 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:36.695079 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.695039 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4"] Jun 03 15:58:36.695551 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.695308 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" containerName="manager" containerID="cri-o://b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559" gracePeriod=2 Jun 03 15:58:36.699363 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.699325 2582 status_manager.go:895] "Failed to get status for pod" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" is forbidden: User \"system:node:ip-10-0-139-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-72.ec2.internal' and this object" Jun 03 15:58:36.700019 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.699973 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4"] Jun 03 15:58:36.756413 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.756378 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb"] Jun 03 15:58:36.756943 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.756913 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" containerName="manager" Jun 03 15:58:36.756943 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.756938 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" containerName="manager" Jun 03 15:58:36.757114 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.757040 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" containerName="manager" Jun 03 15:58:36.760602 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.760576 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" Jun 03 15:58:36.763834 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.763812 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kfvmf\"" Jun 03 15:58:36.772305 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.772241 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb"] Jun 03 15:58:36.785678 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.785627 2582 status_manager.go:895] "Failed to get status for pod" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" is forbidden: User \"system:node:ip-10-0-139-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-72.ec2.internal' and this object" Jun 03 15:58:36.839931 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.839876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wx45\" (UniqueName: \"kubernetes.io/projected/463a9259-4ebf-4355-b464-3d4d276baff4-kube-api-access-7wx45\") pod \"limitador-operator-controller-manager-85c4996f8c-j7cmb\" (UID: \"463a9259-4ebf-4355-b464-3d4d276baff4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" Jun 03 15:58:36.941184 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.941149 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wx45\" (UniqueName: \"kubernetes.io/projected/463a9259-4ebf-4355-b464-3d4d276baff4-kube-api-access-7wx45\") pod \"limitador-operator-controller-manager-85c4996f8c-j7cmb\" (UID: \"463a9259-4ebf-4355-b464-3d4d276baff4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" Jun 03 15:58:36.952203 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:36.952132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wx45\" (UniqueName: \"kubernetes.io/projected/463a9259-4ebf-4355-b464-3d4d276baff4-kube-api-access-7wx45\") pod \"limitador-operator-controller-manager-85c4996f8c-j7cmb\" (UID: \"463a9259-4ebf-4355-b464-3d4d276baff4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" Jun 03 15:58:37.074724 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:37.074690 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" Jun 03 15:58:50.699989 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.699951 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb"] Jun 03 15:58:50.702765 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.702745 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:50.703275 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:58:50.703236 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463a9259_4ebf_4355_b464_3d4d276baff4.slice/crio-4a5a72255985bcf3a04b6e77b58cdccd2b52b1eb4785480a4101ba23ed83943e WatchSource:0}: Error finding container 4a5a72255985bcf3a04b6e77b58cdccd2b52b1eb4785480a4101ba23ed83943e: Status 404 returned error can't find the container with id 4a5a72255985bcf3a04b6e77b58cdccd2b52b1eb4785480a4101ba23ed83943e Jun 03 15:58:50.705597 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.705568 2582 status_manager.go:895] "Failed to get status for pod" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" is forbidden: User \"system:node:ip-10-0-139-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-72.ec2.internal' and this object" Jun 03 15:58:50.867088 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.866991 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-extensions-socket-volume\") pod \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " Jun 03 15:58:50.867088 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.867056 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4plpk\" (UniqueName: \"kubernetes.io/projected/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-kube-api-access-4plpk\") pod \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\" (UID: \"10ac7824-37c0-46e4-9f8e-66ecef3d4e74\") " Jun 03 15:58:50.867555 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.867531 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "10ac7824-37c0-46e4-9f8e-66ecef3d4e74" (UID: "10ac7824-37c0-46e4-9f8e-66ecef3d4e74"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:58:50.869216 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.869195 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-kube-api-access-4plpk" (OuterVolumeSpecName: "kube-api-access-4plpk") pod "10ac7824-37c0-46e4-9f8e-66ecef3d4e74" (UID: "10ac7824-37c0-46e4-9f8e-66ecef3d4e74"). InnerVolumeSpecName "kube-api-access-4plpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:58:50.967957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.967919 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-extensions-socket-volume\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:50.967957 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:50.967951 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4plpk\" (UniqueName: \"kubernetes.io/projected/10ac7824-37c0-46e4-9f8e-66ecef3d4e74-kube-api-access-4plpk\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:58:51.106973 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.106939 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" event={"ID":"463a9259-4ebf-4355-b464-3d4d276baff4","Type":"ContainerStarted","Data":"4a5a72255985bcf3a04b6e77b58cdccd2b52b1eb4785480a4101ba23ed83943e"} Jun 03 15:58:51.111717 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.108821 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" event={"ID":"5b883bf3-725a-4784-8b0c-9a2e5784b9f4","Type":"ContainerStarted","Data":"3129a5988997bd19f63f4cb772c2e997e584ee66b67f7a41a50a27a43eb919de"} Jun 03 15:58:51.112275 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.112222 2582 status_manager.go:895] "Failed to get status for pod" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" is forbidden: User \"system:node:ip-10-0-139-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-72.ec2.internal' and this object" Jun 03 15:58:51.113187 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.113163 2582 generic.go:358] "Generic (PLEG): container finished" podID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" containerID="b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559" exitCode=0 Jun 03 15:58:51.113303 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.113212 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" Jun 03 15:58:51.113303 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.113250 2582 scope.go:117] "RemoveContainer" containerID="b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559" Jun 03 15:58:51.134181 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.134137 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-qvd8f" podStartSLOduration=1.445441869 podStartE2EDuration="25.134123905s" podCreationTimestamp="2026-06-03 15:58:26 +0000 UTC" firstStartedPulling="2026-06-03 15:58:26.961468207 +0000 UTC m=+563.557227883" lastFinishedPulling="2026-06-03 15:58:50.650150244 +0000 UTC m=+587.245909919" observedRunningTime="2026-06-03 15:58:51.134075143 +0000 UTC m=+587.729834838" watchObservedRunningTime="2026-06-03 15:58:51.134123905 +0000 UTC m=+587.729883599" Jun 03 15:58:51.136491 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.136461 2582 status_manager.go:895] "Failed to get status for pod" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-fggm4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-fggm4\" is forbidden: User \"system:node:ip-10-0-139-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-72.ec2.internal' and this object" Jun 03 15:58:51.195607 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.195578 2582 scope.go:117] "RemoveContainer" containerID="b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559" Jun 03 15:58:51.196016 ip-10-0-139-72 kubenswrapper[2582]: E0603 15:58:51.195990 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559\": container with ID starting with b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559 not found: ID does not exist" containerID="b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559" Jun 03 15:58:51.196137 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:51.196029 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559"} err="failed to get container status \"b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559\": rpc error: code = NotFound desc = could not find container \"b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559\": container with ID starting with b42fc7825438b01402694a22b90baab7e5299c3f969909009bd83d989e010559 not found: ID does not exist" Jun 03 15:58:52.038721 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.038694 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10ac7824-37c0-46e4-9f8e-66ecef3d4e74" path="/var/lib/kubelet/pods/10ac7824-37c0-46e4-9f8e-66ecef3d4e74/volumes" Jun 03 15:58:52.119162 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.119125 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" event={"ID":"463a9259-4ebf-4355-b464-3d4d276baff4","Type":"ContainerStarted","Data":"1a45fc6f60dd493c91c7f365d868c36cdc791f29eb5e7421aa790db04fb72724"} Jun 03 15:58:52.140790 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.140739 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" podStartSLOduration=14.867252687 podStartE2EDuration="16.140725296s" podCreationTimestamp="2026-06-03 15:58:36 +0000 UTC" firstStartedPulling="2026-06-03 15:58:50.705037081 +0000 UTC m=+587.300796757" lastFinishedPulling="2026-06-03 15:58:51.978509691 +0000 UTC m=+588.574269366" observedRunningTime="2026-06-03 15:58:52.139287602 +0000 UTC m=+588.735047289" watchObservedRunningTime="2026-06-03 15:58:52.140725296 +0000 UTC m=+588.736484989" Jun 03 15:58:52.511409 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.511374 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd"] Jun 03 15:58:52.520145 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.520127 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.523341 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.523314 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cf8ch\"" Jun 03 15:58:52.528422 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.527832 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd"] Jun 03 15:58:52.682893 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.682860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rzrz\" (UniqueName: \"kubernetes.io/projected/2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad-kube-api-access-6rzrz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-tqncd\" (UID: \"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.682893 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.682896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-tqncd\" (UID: \"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.784235 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.784151 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rzrz\" (UniqueName: \"kubernetes.io/projected/2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad-kube-api-access-6rzrz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-tqncd\" (UID: \"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.784235 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.784192 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-tqncd\" (UID: \"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.784571 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.784554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-tqncd\" (UID: \"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.794852 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.794823 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rzrz\" (UniqueName: \"kubernetes.io/projected/2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad-kube-api-access-6rzrz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-tqncd\" (UID: \"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.831414 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.831381 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:58:52.970766 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:52.970741 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd"] Jun 03 15:58:52.972730 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:58:52.972700 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aeaa5ef_1d8b_4a17_a642_d7cc2451aaad.slice/crio-3c607396819d4e2484b7984ae2789d207ddb421b4470095c402a0f96c34f57fa WatchSource:0}: Error finding container 3c607396819d4e2484b7984ae2789d207ddb421b4470095c402a0f96c34f57fa: Status 404 returned error can't find the container with id 3c607396819d4e2484b7984ae2789d207ddb421b4470095c402a0f96c34f57fa Jun 03 15:58:53.124185 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:53.124153 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" event={"ID":"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad","Type":"ContainerStarted","Data":"7bfeec2c920a513df226f85327e368661b88bde03ddaf2bc3a9dc24f5fd222dd"} Jun 03 15:58:53.124676 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:53.124191 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" event={"ID":"2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad","Type":"ContainerStarted","Data":"3c607396819d4e2484b7984ae2789d207ddb421b4470095c402a0f96c34f57fa"} Jun 03 15:58:53.124676 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:53.124392 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" Jun 03 15:58:54.170964 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:58:54.170910 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" podStartSLOduration=2.170897228 podStartE2EDuration="2.170897228s" podCreationTimestamp="2026-06-03 15:58:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:58:54.167907449 +0000 UTC m=+590.763667143" watchObservedRunningTime="2026-06-03 15:58:54.170897228 +0000 UTC m=+590.766656921" Jun 03 15:59:04.129406 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:04.129359 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:59:04.131098 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:04.131071 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-j7cmb" Jun 03 15:59:04.131216 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:04.131124 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-tqncd" Jun 03 15:59:52.772075 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.772038 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq"] Jun 03 15:59:52.774642 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.774625 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.779054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.779031 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 15:59:52.780366 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.780343 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-flvl5\"" Jun 03 15:59:52.780491 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.780379 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 15:59:52.786782 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.786754 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq"] Jun 03 15:59:52.822095 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.822061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74j6t\" (UniqueName: \"kubernetes.io/projected/001f8383-7d9d-4473-893c-526eda847fbb-kube-api-access-74j6t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.822230 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.822123 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.822230 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.822163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.923357 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.923304 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74j6t\" (UniqueName: \"kubernetes.io/projected/001f8383-7d9d-4473-893c-526eda847fbb-kube-api-access-74j6t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.923538 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.923402 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.923538 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.923432 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.923792 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.923769 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.923844 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.923816 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:52.934795 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:52.934765 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74j6t\" (UniqueName: \"kubernetes.io/projected/001f8383-7d9d-4473-893c-526eda847fbb-kube-api-access-74j6t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:53.084303 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:53.084194 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:53.219033 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:53.219009 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq"] Jun 03 15:59:53.220864 ip-10-0-139-72 kubenswrapper[2582]: W0603 15:59:53.220826 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001f8383_7d9d_4473_893c_526eda847fbb.slice/crio-6d9b647d1f44e3eb413b5ee71403a1a7c53321009b4f0b0f6742d4ac63cc75a1 WatchSource:0}: Error finding container 6d9b647d1f44e3eb413b5ee71403a1a7c53321009b4f0b0f6742d4ac63cc75a1: Status 404 returned error can't find the container with id 6d9b647d1f44e3eb413b5ee71403a1a7c53321009b4f0b0f6742d4ac63cc75a1 Jun 03 15:59:53.222999 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:53.222980 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:59:53.351908 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:53.351836 2582 generic.go:358] "Generic (PLEG): container finished" podID="001f8383-7d9d-4473-893c-526eda847fbb" containerID="68ea72bd7077c84e3698d4d335722c193d566f1b699e5b6f1561881f043722ac" exitCode=0 Jun 03 15:59:53.352034 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:53.351921 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" event={"ID":"001f8383-7d9d-4473-893c-526eda847fbb","Type":"ContainerDied","Data":"68ea72bd7077c84e3698d4d335722c193d566f1b699e5b6f1561881f043722ac"} Jun 03 15:59:53.352034 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:53.351965 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" event={"ID":"001f8383-7d9d-4473-893c-526eda847fbb","Type":"ContainerStarted","Data":"6d9b647d1f44e3eb413b5ee71403a1a7c53321009b4f0b0f6742d4ac63cc75a1"} Jun 03 15:59:54.357585 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:54.357545 2582 generic.go:358] "Generic (PLEG): container finished" podID="001f8383-7d9d-4473-893c-526eda847fbb" containerID="aaaf6b3b11554ff05f3a899adf916339796148a2b6897cb186149dd0dddf1be2" exitCode=0 Jun 03 15:59:54.358054 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:54.357616 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" event={"ID":"001f8383-7d9d-4473-893c-526eda847fbb","Type":"ContainerDied","Data":"aaaf6b3b11554ff05f3a899adf916339796148a2b6897cb186149dd0dddf1be2"} Jun 03 15:59:55.363401 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:55.363366 2582 generic.go:358] "Generic (PLEG): container finished" podID="001f8383-7d9d-4473-893c-526eda847fbb" containerID="8263a10ac68f85046e3a133339873427f99ea923b2b55a60aa69be62d1040aac" exitCode=0 Jun 03 15:59:55.363779 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:55.363433 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" event={"ID":"001f8383-7d9d-4473-893c-526eda847fbb","Type":"ContainerDied","Data":"8263a10ac68f85046e3a133339873427f99ea923b2b55a60aa69be62d1040aac"} Jun 03 15:59:56.502450 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.502426 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 15:59:56.559433 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.559387 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-util\") pod \"001f8383-7d9d-4473-893c-526eda847fbb\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " Jun 03 15:59:56.559630 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.559454 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-bundle\") pod \"001f8383-7d9d-4473-893c-526eda847fbb\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " Jun 03 15:59:56.559630 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.559531 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74j6t\" (UniqueName: \"kubernetes.io/projected/001f8383-7d9d-4473-893c-526eda847fbb-kube-api-access-74j6t\") pod \"001f8383-7d9d-4473-893c-526eda847fbb\" (UID: \"001f8383-7d9d-4473-893c-526eda847fbb\") " Jun 03 15:59:56.559958 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.559932 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-bundle" (OuterVolumeSpecName: "bundle") pod "001f8383-7d9d-4473-893c-526eda847fbb" (UID: "001f8383-7d9d-4473-893c-526eda847fbb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:59:56.561839 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.561815 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001f8383-7d9d-4473-893c-526eda847fbb-kube-api-access-74j6t" (OuterVolumeSpecName: "kube-api-access-74j6t") pod "001f8383-7d9d-4473-893c-526eda847fbb" (UID: "001f8383-7d9d-4473-893c-526eda847fbb"). InnerVolumeSpecName "kube-api-access-74j6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:59:56.565806 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.565782 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-util" (OuterVolumeSpecName: "util") pod "001f8383-7d9d-4473-893c-526eda847fbb" (UID: "001f8383-7d9d-4473-893c-526eda847fbb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:59:56.660469 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.660377 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74j6t\" (UniqueName: \"kubernetes.io/projected/001f8383-7d9d-4473-893c-526eda847fbb-kube-api-access-74j6t\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:59:56.660469 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.660418 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-util\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:59:56.660469 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:56.660429 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001f8383-7d9d-4473-893c-526eda847fbb-bundle\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 15:59:57.378213 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:57.378177 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" event={"ID":"001f8383-7d9d-4473-893c-526eda847fbb","Type":"ContainerDied","Data":"6d9b647d1f44e3eb413b5ee71403a1a7c53321009b4f0b0f6742d4ac63cc75a1"} Jun 03 15:59:57.378213 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:57.378212 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d9b647d1f44e3eb413b5ee71403a1a7c53321009b4f0b0f6742d4ac63cc75a1" Jun 03 15:59:57.378430 ip-10-0-139-72 kubenswrapper[2582]: I0603 15:59:57.378219 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70fj5dq" Jun 03 16:00:51.131673 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.131527 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ffdd5497-wqkkv"] Jun 03 16:00:51.132105 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.131915 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001f8383-7d9d-4473-893c-526eda847fbb" containerName="pull" Jun 03 16:00:51.132105 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.131931 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="001f8383-7d9d-4473-893c-526eda847fbb" containerName="pull" Jun 03 16:00:51.132105 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.131939 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001f8383-7d9d-4473-893c-526eda847fbb" containerName="util" Jun 03 16:00:51.132105 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.131945 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="001f8383-7d9d-4473-893c-526eda847fbb" containerName="util" Jun 03 16:00:51.132105 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.131950 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001f8383-7d9d-4473-893c-526eda847fbb" containerName="extract" Jun 03 16:00:51.132105 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.131957 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="001f8383-7d9d-4473-893c-526eda847fbb" containerName="extract" Jun 03 16:00:51.132105 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.132012 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="001f8383-7d9d-4473-893c-526eda847fbb" containerName="extract" Jun 03 16:00:51.134915 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.134893 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:00:51.138095 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.138071 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xfgxn\"" Jun 03 16:00:51.138222 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.138080 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 16:00:51.146865 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.146839 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffdd5497-wqkkv"] Jun 03 16:00:51.228073 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.228038 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkhj\" (UniqueName: \"kubernetes.io/projected/a4761bd7-109a-4607-8930-d66a25cd4d89-kube-api-access-tfkhj\") pod \"maas-controller-7ffdd5497-wqkkv\" (UID: \"a4761bd7-109a-4607-8930-d66a25cd4d89\") " pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:00:51.329354 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.329319 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkhj\" (UniqueName: \"kubernetes.io/projected/a4761bd7-109a-4607-8930-d66a25cd4d89-kube-api-access-tfkhj\") pod \"maas-controller-7ffdd5497-wqkkv\" (UID: \"a4761bd7-109a-4607-8930-d66a25cd4d89\") " pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:00:51.339901 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.339869 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkhj\" (UniqueName: \"kubernetes.io/projected/a4761bd7-109a-4607-8930-d66a25cd4d89-kube-api-access-tfkhj\") pod \"maas-controller-7ffdd5497-wqkkv\" (UID: \"a4761bd7-109a-4607-8930-d66a25cd4d89\") " pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:00:51.446340 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.446224 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:00:51.581962 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:51.581934 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffdd5497-wqkkv"] Jun 03 16:00:51.584734 ip-10-0-139-72 kubenswrapper[2582]: W0603 16:00:51.584698 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4761bd7_109a_4607_8930_d66a25cd4d89.slice/crio-5e721d72d63d0375db75c04a0c7bd856b367c4aa855ef1138ae8cbb94d9a1443 WatchSource:0}: Error finding container 5e721d72d63d0375db75c04a0c7bd856b367c4aa855ef1138ae8cbb94d9a1443: Status 404 returned error can't find the container with id 5e721d72d63d0375db75c04a0c7bd856b367c4aa855ef1138ae8cbb94d9a1443 Jun 03 16:00:52.587571 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:52.587527 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" event={"ID":"a4761bd7-109a-4607-8930-d66a25cd4d89","Type":"ContainerStarted","Data":"5e721d72d63d0375db75c04a0c7bd856b367c4aa855ef1138ae8cbb94d9a1443"} Jun 03 16:00:54.599271 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:54.599230 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" event={"ID":"a4761bd7-109a-4607-8930-d66a25cd4d89","Type":"ContainerStarted","Data":"467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3"} Jun 03 16:00:54.599678 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:54.599503 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:00:54.623557 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:00:54.623499 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" podStartSLOduration=1.128719186 podStartE2EDuration="3.623483766s" podCreationTimestamp="2026-06-03 16:00:51 +0000 UTC" firstStartedPulling="2026-06-03 16:00:51.585826927 +0000 UTC m=+708.181586598" lastFinishedPulling="2026-06-03 16:00:54.080591499 +0000 UTC m=+710.676351178" observedRunningTime="2026-06-03 16:00:54.620984225 +0000 UTC m=+711.216743918" watchObservedRunningTime="2026-06-03 16:00:54.623483766 +0000 UTC m=+711.219243460" Jun 03 16:01:05.609115 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:05.609077 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:01:05.685974 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:05.685938 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ffdd5497-wqkkv"] Jun 03 16:01:05.686151 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:05.686133 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" podUID="a4761bd7-109a-4607-8930-d66a25cd4d89" containerName="manager" containerID="cri-o://467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3" gracePeriod=30 Jun 03 16:01:05.923878 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:05.923854 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:01:06.062715 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.062684 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfkhj\" (UniqueName: \"kubernetes.io/projected/a4761bd7-109a-4607-8930-d66a25cd4d89-kube-api-access-tfkhj\") pod \"a4761bd7-109a-4607-8930-d66a25cd4d89\" (UID: \"a4761bd7-109a-4607-8930-d66a25cd4d89\") " Jun 03 16:01:06.065017 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.064979 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4761bd7-109a-4607-8930-d66a25cd4d89-kube-api-access-tfkhj" (OuterVolumeSpecName: "kube-api-access-tfkhj") pod "a4761bd7-109a-4607-8930-d66a25cd4d89" (UID: "a4761bd7-109a-4607-8930-d66a25cd4d89"). InnerVolumeSpecName "kube-api-access-tfkhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:01:06.163817 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.163728 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfkhj\" (UniqueName: \"kubernetes.io/projected/a4761bd7-109a-4607-8930-d66a25cd4d89-kube-api-access-tfkhj\") on node \"ip-10-0-139-72.ec2.internal\" DevicePath \"\"" Jun 03 16:01:06.644611 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.644570 2582 generic.go:358] "Generic (PLEG): container finished" podID="a4761bd7-109a-4607-8930-d66a25cd4d89" containerID="467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3" exitCode=0 Jun 03 16:01:06.645038 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.644639 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" Jun 03 16:01:06.645038 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.644653 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" event={"ID":"a4761bd7-109a-4607-8930-d66a25cd4d89","Type":"ContainerDied","Data":"467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3"} Jun 03 16:01:06.645038 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.644692 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffdd5497-wqkkv" event={"ID":"a4761bd7-109a-4607-8930-d66a25cd4d89","Type":"ContainerDied","Data":"5e721d72d63d0375db75c04a0c7bd856b367c4aa855ef1138ae8cbb94d9a1443"} Jun 03 16:01:06.645038 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.644707 2582 scope.go:117] "RemoveContainer" containerID="467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3" Jun 03 16:01:06.654647 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.654631 2582 scope.go:117] "RemoveContainer" containerID="467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3" Jun 03 16:01:06.654900 ip-10-0-139-72 kubenswrapper[2582]: E0603 16:01:06.654883 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3\": container with ID starting with 467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3 not found: ID does not exist" containerID="467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3" Jun 03 16:01:06.654943 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.654912 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3"} err="failed to get container status \"467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3\": rpc error: code = NotFound desc = could not find container \"467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3\": container with ID starting with 467995ff846f088d234a2fac5c391f011413809357efb958365c65d7af899fa3 not found: ID does not exist" Jun 03 16:01:06.687455 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.687414 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ffdd5497-wqkkv"] Jun 03 16:01:06.693196 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:06.693171 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7ffdd5497-wqkkv"] Jun 03 16:01:08.035448 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:08.035417 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4761bd7-109a-4607-8930-d66a25cd4d89" path="/var/lib/kubelet/pods/a4761bd7-109a-4607-8930-d66a25cd4d89/volumes" Jun 03 16:01:27.873623 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.873587 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-dmjzg"] Jun 03 16:01:27.874127 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.874107 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4761bd7-109a-4607-8930-d66a25cd4d89" containerName="manager" Jun 03 16:01:27.874205 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.874132 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4761bd7-109a-4607-8930-d66a25cd4d89" containerName="manager" Jun 03 16:01:27.874304 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.874222 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4761bd7-109a-4607-8930-d66a25cd4d89" containerName="manager" Jun 03 16:01:27.877086 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.877066 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" Jun 03 16:01:27.880132 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.880112 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 16:01:27.880274 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.880114 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vn2mb\"" Jun 03 16:01:27.888345 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.888321 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-dmjzg"] Jun 03 16:01:27.951320 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:27.951284 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rt69\" (UniqueName: \"kubernetes.io/projected/eede83b4-391a-4b42-9a36-7a8e19ecc37b-kube-api-access-2rt69\") pod \"payload-processing-58b6c8fdc7-dmjzg\" (UID: \"eede83b4-391a-4b42-9a36-7a8e19ecc37b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" Jun 03 16:01:28.052151 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:28.052109 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rt69\" (UniqueName: \"kubernetes.io/projected/eede83b4-391a-4b42-9a36-7a8e19ecc37b-kube-api-access-2rt69\") pod \"payload-processing-58b6c8fdc7-dmjzg\" (UID: \"eede83b4-391a-4b42-9a36-7a8e19ecc37b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" Jun 03 16:01:28.065046 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:28.065018 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rt69\" (UniqueName: \"kubernetes.io/projected/eede83b4-391a-4b42-9a36-7a8e19ecc37b-kube-api-access-2rt69\") pod \"payload-processing-58b6c8fdc7-dmjzg\" (UID: \"eede83b4-391a-4b42-9a36-7a8e19ecc37b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" Jun 03 16:01:28.187669 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:28.187561 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" Jun 03 16:01:28.327404 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:28.327381 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-dmjzg"] Jun 03 16:01:28.329802 ip-10-0-139-72 kubenswrapper[2582]: W0603 16:01:28.329773 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeede83b4_391a_4b42_9a36_7a8e19ecc37b.slice/crio-19a9edb41596ab5b671136fbc05f3e8650ddbc34635b76091d57a50adf4fe9ab WatchSource:0}: Error finding container 19a9edb41596ab5b671136fbc05f3e8650ddbc34635b76091d57a50adf4fe9ab: Status 404 returned error can't find the container with id 19a9edb41596ab5b671136fbc05f3e8650ddbc34635b76091d57a50adf4fe9ab Jun 03 16:01:28.738411 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:28.738374 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" event={"ID":"eede83b4-391a-4b42-9a36-7a8e19ecc37b","Type":"ContainerStarted","Data":"19a9edb41596ab5b671136fbc05f3e8650ddbc34635b76091d57a50adf4fe9ab"} Jun 03 16:01:30.749186 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:30.749145 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" event={"ID":"eede83b4-391a-4b42-9a36-7a8e19ecc37b","Type":"ContainerStarted","Data":"3f51a8aa8575eb15f3d628d33417c45815ff0289c19044eeb6f91850f2cfa60e"} Jun 03 16:01:30.749639 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:30.749313 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" Jun 03 16:01:41.755850 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:41.755820 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" Jun 03 16:01:41.777323 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:01:41.777249 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-dmjzg" podStartSLOduration=12.566356915 podStartE2EDuration="14.777235159s" podCreationTimestamp="2026-06-03 16:01:27 +0000 UTC" firstStartedPulling="2026-06-03 16:01:28.331603799 +0000 UTC m=+744.927363470" lastFinishedPulling="2026-06-03 16:01:30.542482043 +0000 UTC m=+747.138241714" observedRunningTime="2026-06-03 16:01:30.793711776 +0000 UTC m=+747.389471470" watchObservedRunningTime="2026-06-03 16:01:41.777235159 +0000 UTC m=+758.372994863" Jun 03 16:02:52.384445 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.384409 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8"] Jun 03 16:02:52.388046 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.388021 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.392334 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.392310 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 16:02:52.392482 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.392348 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 16:02:52.392482 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.392315 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z6r2v\"" Jun 03 16:02:52.392482 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.392355 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 16:02:52.399768 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.399745 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8"] Jun 03 16:02:52.486366 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.486333 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfv6q\" (UniqueName: \"kubernetes.io/projected/cfbebca0-0a67-4f2d-9cf1-082ee298f656-kube-api-access-vfv6q\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.486538 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.486373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.486538 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.486402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbebca0-0a67-4f2d-9cf1-082ee298f656-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.486538 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.486514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.486646 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.486554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.486646 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.486592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.587738 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.587696 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.587932 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.587751 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.587932 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.587769 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.587932 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.587791 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfv6q\" (UniqueName: \"kubernetes.io/projected/cfbebca0-0a67-4f2d-9cf1-082ee298f656-kube-api-access-vfv6q\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.587932 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.587808 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.588151 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.587926 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbebca0-0a67-4f2d-9cf1-082ee298f656-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.588235 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.588214 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.588332 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.588232 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.588332 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.588294 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.590387 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.590364 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfbebca0-0a67-4f2d-9cf1-082ee298f656-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.590620 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.590605 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfbebca0-0a67-4f2d-9cf1-082ee298f656-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.598964 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.598941 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfv6q\" (UniqueName: \"kubernetes.io/projected/cfbebca0-0a67-4f2d-9cf1-082ee298f656-kube-api-access-vfv6q\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8\" (UID: \"cfbebca0-0a67-4f2d-9cf1-082ee298f656\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.700774 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.700681 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:02:52.838003 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:52.837976 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8"] Jun 03 16:02:52.839372 ip-10-0-139-72 kubenswrapper[2582]: W0603 16:02:52.839335 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbebca0_0a67_4f2d_9cf1_082ee298f656.slice/crio-660c3f71ec3a54e812b6d02a8b656af3955a506f1d6d09060994c2634c6fb52d WatchSource:0}: Error finding container 660c3f71ec3a54e812b6d02a8b656af3955a506f1d6d09060994c2634c6fb52d: Status 404 returned error can't find the container with id 660c3f71ec3a54e812b6d02a8b656af3955a506f1d6d09060994c2634c6fb52d Jun 03 16:02:53.067133 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:53.067088 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" event={"ID":"cfbebca0-0a67-4f2d-9cf1-082ee298f656","Type":"ContainerStarted","Data":"660c3f71ec3a54e812b6d02a8b656af3955a506f1d6d09060994c2634c6fb52d"} Jun 03 16:02:57.085712 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:02:57.085668 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" event={"ID":"cfbebca0-0a67-4f2d-9cf1-082ee298f656","Type":"ContainerStarted","Data":"cc0ab2c1c8e03b3c29d3875ea52b1498bf61c0f0a7496ce4f6be10e9200b8cd0"} Jun 03 16:03:02.204501 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.204466 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747"] Jun 03 16:03:02.209150 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.209127 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.212147 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.212122 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 16:03:02.220630 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.220606 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747"] Jun 03 16:03:02.271639 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.271598 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.271639 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.271639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fb1272-05dd-4351-80d1-8b14a2e60d5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.271888 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.271663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.271888 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.271733 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.271888 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.271764 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.271888 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.271853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhq9n\" (UniqueName: \"kubernetes.io/projected/16fb1272-05dd-4351-80d1-8b14a2e60d5c-kube-api-access-jhq9n\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373189 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373146 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373400 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373209 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhq9n\" (UniqueName: \"kubernetes.io/projected/16fb1272-05dd-4351-80d1-8b14a2e60d5c-kube-api-access-jhq9n\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373400 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373242 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373400 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373291 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fb1272-05dd-4351-80d1-8b14a2e60d5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373400 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373322 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373400 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373373 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373720 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373695 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373774 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373717 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.373774 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.373742 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.375746 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.375723 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16fb1272-05dd-4351-80d1-8b14a2e60d5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.375849 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.375831 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16fb1272-05dd-4351-80d1-8b14a2e60d5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.387354 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.387324 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhq9n\" (UniqueName: \"kubernetes.io/projected/16fb1272-05dd-4351-80d1-8b14a2e60d5c-kube-api-access-jhq9n\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747\" (UID: \"16fb1272-05dd-4351-80d1-8b14a2e60d5c\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.520559 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.520502 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:02.666626 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:02.666601 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747"] Jun 03 16:03:02.667494 ip-10-0-139-72 kubenswrapper[2582]: W0603 16:03:02.667469 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fb1272_05dd_4351_80d1_8b14a2e60d5c.slice/crio-b472fee63f9c8ceae3a61e44651ecad0c9bc6510113de7674e627f5ee4288478 WatchSource:0}: Error finding container b472fee63f9c8ceae3a61e44651ecad0c9bc6510113de7674e627f5ee4288478: Status 404 returned error can't find the container with id b472fee63f9c8ceae3a61e44651ecad0c9bc6510113de7674e627f5ee4288478 Jun 03 16:03:03.111627 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:03.111593 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" event={"ID":"16fb1272-05dd-4351-80d1-8b14a2e60d5c","Type":"ContainerStarted","Data":"9487587b5d87d0438b214220757e092e338e97d413099483bfc0543c769f7bb8"} Jun 03 16:03:03.111627 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:03.111633 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" event={"ID":"16fb1272-05dd-4351-80d1-8b14a2e60d5c","Type":"ContainerStarted","Data":"b472fee63f9c8ceae3a61e44651ecad0c9bc6510113de7674e627f5ee4288478"} Jun 03 16:03:08.132231 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:08.132145 2582 generic.go:358] "Generic (PLEG): container finished" podID="16fb1272-05dd-4351-80d1-8b14a2e60d5c" containerID="9487587b5d87d0438b214220757e092e338e97d413099483bfc0543c769f7bb8" exitCode=0 Jun 03 16:03:08.132231 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:08.132215 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" event={"ID":"16fb1272-05dd-4351-80d1-8b14a2e60d5c","Type":"ContainerDied","Data":"9487587b5d87d0438b214220757e092e338e97d413099483bfc0543c769f7bb8"} Jun 03 16:03:10.143604 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:10.143568 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" event={"ID":"16fb1272-05dd-4351-80d1-8b14a2e60d5c","Type":"ContainerStarted","Data":"3b8978a370a4a6900ff5443ba68aed24ff06ed9b50b820d6f26fbc0aa872124f"} Jun 03 16:03:10.166685 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:10.166627 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" podStartSLOduration=6.8116360369999995 podStartE2EDuration="8.166612334s" podCreationTimestamp="2026-06-03 16:03:02 +0000 UTC" firstStartedPulling="2026-06-03 16:03:08.132829561 +0000 UTC m=+844.728589233" lastFinishedPulling="2026-06-03 16:03:09.487805844 +0000 UTC m=+846.083565530" observedRunningTime="2026-06-03 16:03:10.165612682 +0000 UTC m=+846.761372377" watchObservedRunningTime="2026-06-03 16:03:10.166612334 +0000 UTC m=+846.762372056" Jun 03 16:03:12.521654 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:12.521603 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:12.522100 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:12.521801 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:12.533964 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:12.533943 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:13.166533 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:13.166504 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747" Jun 03 16:03:58.335402 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:58.335365 2582 generic.go:358] "Generic (PLEG): container finished" podID="cfbebca0-0a67-4f2d-9cf1-082ee298f656" containerID="cc0ab2c1c8e03b3c29d3875ea52b1498bf61c0f0a7496ce4f6be10e9200b8cd0" exitCode=0 Jun 03 16:03:58.335836 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:03:58.335443 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" event={"ID":"cfbebca0-0a67-4f2d-9cf1-082ee298f656","Type":"ContainerDied","Data":"cc0ab2c1c8e03b3c29d3875ea52b1498bf61c0f0a7496ce4f6be10e9200b8cd0"} Jun 03 16:04:03.359492 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:04:03.359460 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" event={"ID":"cfbebca0-0a67-4f2d-9cf1-082ee298f656","Type":"ContainerStarted","Data":"0a09b0f714a9490835b0fba40fc64cb0f29b34ffc87efe9601e50273fac18c36"} Jun 03 16:04:03.382859 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:04:03.382799 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" podStartSLOduration=1.868439537 podStartE2EDuration="1m11.382783243s" podCreationTimestamp="2026-06-03 16:02:52 +0000 UTC" firstStartedPulling="2026-06-03 16:02:52.841019843 +0000 UTC m=+829.436779515" lastFinishedPulling="2026-06-03 16:04:02.355363549 +0000 UTC m=+898.951123221" observedRunningTime="2026-06-03 16:04:03.38101904 +0000 UTC m=+899.976778735" watchObservedRunningTime="2026-06-03 16:04:03.382783243 +0000 UTC m=+899.978542937" Jun 03 16:04:12.701155 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:04:12.701112 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:04:12.701583 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:04:12.701171 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:04:12.713613 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:04:12.713584 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:04:13.411151 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:04:13.411122 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8" Jun 03 16:09:33.022764 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:33.022731 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-mnf4k_e1d47d11-032d-40b1-8842-593dfab05cdf/manager/0.log" Jun 03 16:09:33.038630 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:33.038603 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-mnf4k_e1d47d11-032d-40b1-8842-593dfab05cdf/copy-manifests/0.log" Jun 03 16:09:33.958588 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:33.958557 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs_34ad32ec-9715-4dd0-8b26-f921e58e0322/extract/0.log" Jun 03 16:09:33.972336 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:33.972310 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs_34ad32ec-9715-4dd0-8b26-f921e58e0322/util/0.log" Jun 03 16:09:33.990319 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:33.990291 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs_34ad32ec-9715-4dd0-8b26-f921e58e0322/pull/0.log" Jun 03 16:09:34.109180 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.109144 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt_9593a94d-6c95-46a7-aace-54c010279586/util/0.log" Jun 03 16:09:34.147299 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.147253 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt_9593a94d-6c95-46a7-aace-54c010279586/pull/0.log" Jun 03 16:09:34.157778 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.157752 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt_9593a94d-6c95-46a7-aace-54c010279586/extract/0.log" Jun 03 16:09:34.290789 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.290756 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf_114198f4-4d42-455d-943d-2e4e0e75412a/util/0.log" Jun 03 16:09:34.305856 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.305831 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf_114198f4-4d42-455d-943d-2e4e0e75412a/pull/0.log" Jun 03 16:09:34.320721 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.320699 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf_114198f4-4d42-455d-943d-2e4e0e75412a/extract/0.log" Jun 03 16:09:34.448703 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.448672 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz_6c9697ce-659a-475a-9909-d011f6cd5e94/util/0.log" Jun 03 16:09:34.463037 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.463008 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz_6c9697ce-659a-475a-9909-d011f6cd5e94/pull/0.log" Jun 03 16:09:34.474688 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.474666 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz_6c9697ce-659a-475a-9909-d011f6cd5e94/extract/0.log" Jun 03 16:09:34.970358 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:34.970328 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-qvd8f_5b883bf3-725a-4784-8b0c-9a2e5784b9f4/kuadrant-console-plugin/0.log" Jun 03 16:09:35.208317 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:35.208282 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-tqncd_2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad/manager/0.log" Jun 03 16:09:35.442150 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:35.442072 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-j7cmb_463a9259-4ebf-4355-b464-3d4d276baff4/manager/0.log" Jun 03 16:09:36.211110 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:36.211067 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b7b64cc-cvfwg_67494cdc-037a-44d3-b5f7-81d917021dae/kube-auth-proxy/0.log" Jun 03 16:09:36.455411 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:36.455373 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-dmjzg_eede83b4-391a-4b42-9a36-7a8e19ecc37b/payload-processing/0.log" Jun 03 16:09:37.211653 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:37.211623 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8_cfbebca0-0a67-4f2d-9cf1-082ee298f656/main/0.log" Jun 03 16:09:37.222341 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:37.222320 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-9cvx8_cfbebca0-0a67-4f2d-9cf1-082ee298f656/storage-initializer/0.log" Jun 03 16:09:37.480893 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:37.480853 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747_16fb1272-05dd-4351-80d1-8b14a2e60d5c/storage-initializer/0.log" Jun 03 16:09:37.495106 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:37.495076 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-t9747_16fb1272-05dd-4351-80d1-8b14a2e60d5c/main/0.log" Jun 03 16:09:42.132914 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.132805 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpskt/must-gather-9jsbw"] Jun 03 16:09:42.135503 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.135488 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.148070 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.148047 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpskt\"/\"openshift-service-ca.crt\"" Jun 03 16:09:42.150721 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.150705 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpskt\"/\"kube-root-ca.crt\"" Jun 03 16:09:42.151858 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.151837 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpskt\"/\"default-dockercfg-ff6qh\"" Jun 03 16:09:42.182946 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.182921 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/must-gather-9jsbw"] Jun 03 16:09:42.281159 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.281120 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqd9j\" (UniqueName: \"kubernetes.io/projected/fda9835e-9a95-41f3-b023-fa2455f08e1a-kube-api-access-pqd9j\") pod \"must-gather-9jsbw\" (UID: \"fda9835e-9a95-41f3-b023-fa2455f08e1a\") " pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.281366 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.281170 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fda9835e-9a95-41f3-b023-fa2455f08e1a-must-gather-output\") pod \"must-gather-9jsbw\" (UID: \"fda9835e-9a95-41f3-b023-fa2455f08e1a\") " pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.382337 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.382291 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqd9j\" (UniqueName: \"kubernetes.io/projected/fda9835e-9a95-41f3-b023-fa2455f08e1a-kube-api-access-pqd9j\") pod \"must-gather-9jsbw\" (UID: \"fda9835e-9a95-41f3-b023-fa2455f08e1a\") " pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.382524 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.382352 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fda9835e-9a95-41f3-b023-fa2455f08e1a-must-gather-output\") pod \"must-gather-9jsbw\" (UID: \"fda9835e-9a95-41f3-b023-fa2455f08e1a\") " pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.382731 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.382713 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fda9835e-9a95-41f3-b023-fa2455f08e1a-must-gather-output\") pod \"must-gather-9jsbw\" (UID: \"fda9835e-9a95-41f3-b023-fa2455f08e1a\") " pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.398600 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.398533 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqd9j\" (UniqueName: \"kubernetes.io/projected/fda9835e-9a95-41f3-b023-fa2455f08e1a-kube-api-access-pqd9j\") pod \"must-gather-9jsbw\" (UID: \"fda9835e-9a95-41f3-b023-fa2455f08e1a\") " pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.444481 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.444440 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/must-gather-9jsbw" Jun 03 16:09:42.588248 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.588212 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/must-gather-9jsbw"] Jun 03 16:09:42.591562 ip-10-0-139-72 kubenswrapper[2582]: W0603 16:09:42.591534 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfda9835e_9a95_41f3_b023_fa2455f08e1a.slice/crio-a67cf7c0a2a16ebfe1be9193471cd06d536b0f1a8ec417d986743c56ad29d3c9 WatchSource:0}: Error finding container a67cf7c0a2a16ebfe1be9193471cd06d536b0f1a8ec417d986743c56ad29d3c9: Status 404 returned error can't find the container with id a67cf7c0a2a16ebfe1be9193471cd06d536b0f1a8ec417d986743c56ad29d3c9 Jun 03 16:09:42.593210 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.593191 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:09:42.677336 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:42.677226 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/must-gather-9jsbw" event={"ID":"fda9835e-9a95-41f3-b023-fa2455f08e1a","Type":"ContainerStarted","Data":"a67cf7c0a2a16ebfe1be9193471cd06d536b0f1a8ec417d986743c56ad29d3c9"} Jun 03 16:09:43.687349 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:43.687238 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/must-gather-9jsbw" event={"ID":"fda9835e-9a95-41f3-b023-fa2455f08e1a","Type":"ContainerStarted","Data":"977c607398ed4fb51cf4d27acc2ec6ea51d09c46ff8ab45499ba33140a76c013"} Jun 03 16:09:43.687349 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:43.687304 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/must-gather-9jsbw" event={"ID":"fda9835e-9a95-41f3-b023-fa2455f08e1a","Type":"ContainerStarted","Data":"54b9eebf4dfdd1e680463c00fb5c3bdcd29a4c1792146d6bd3aa562e415373ce"} Jun 03 16:09:43.719390 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:43.719336 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wpskt/must-gather-9jsbw" podStartSLOduration=0.919583554 podStartE2EDuration="1.719319971s" podCreationTimestamp="2026-06-03 16:09:42 +0000 UTC" firstStartedPulling="2026-06-03 16:09:42.593339448 +0000 UTC m=+1239.189099120" lastFinishedPulling="2026-06-03 16:09:43.393075849 +0000 UTC m=+1239.988835537" observedRunningTime="2026-06-03 16:09:43.719303142 +0000 UTC m=+1240.315062836" watchObservedRunningTime="2026-06-03 16:09:43.719319971 +0000 UTC m=+1240.315079667" Jun 03 16:09:45.868362 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:45.868296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wfz5l_5846aab1-b857-4513-9c6c-0cb11d811c4d/global-pull-secret-syncer/0.log" Jun 03 16:09:46.064066 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:46.064028 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j5gdd_22772c03-b3eb-4adc-9506-a2c893508a04/konnectivity-agent/0.log" Jun 03 16:09:46.282295 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:46.282222 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-72.ec2.internal_bf6fe2708a04c0590747b24b7dfe25f1/haproxy/0.log" Jun 03 16:09:49.599597 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:49.599505 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs_34ad32ec-9715-4dd0-8b26-f921e58e0322/extract/0.log" Jun 03 16:09:49.632456 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:49.632429 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs_34ad32ec-9715-4dd0-8b26-f921e58e0322/util/0.log" Jun 03 16:09:49.674059 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:49.674007 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597kwqs_34ad32ec-9715-4dd0-8b26-f921e58e0322/pull/0.log" Jun 03 16:09:49.724593 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:49.724561 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt_9593a94d-6c95-46a7-aace-54c010279586/extract/0.log" Jun 03 16:09:49.775663 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:49.775628 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt_9593a94d-6c95-46a7-aace-54c010279586/util/0.log" Jun 03 16:09:49.827783 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:49.827756 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rkvt_9593a94d-6c95-46a7-aace-54c010279586/pull/0.log" Jun 03 16:09:49.973168 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:49.973141 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf_114198f4-4d42-455d-943d-2e4e0e75412a/extract/0.log" Jun 03 16:09:50.044171 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.044139 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf_114198f4-4d42-455d-943d-2e4e0e75412a/util/0.log" Jun 03 16:09:50.137183 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.137155 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73m7wbf_114198f4-4d42-455d-943d-2e4e0e75412a/pull/0.log" Jun 03 16:09:50.186957 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.186923 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz_6c9697ce-659a-475a-9909-d011f6cd5e94/extract/0.log" Jun 03 16:09:50.227242 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.227146 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz_6c9697ce-659a-475a-9909-d011f6cd5e94/util/0.log" Jun 03 16:09:50.279286 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.279231 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19t7gz_6c9697ce-659a-475a-9909-d011f6cd5e94/pull/0.log" Jun 03 16:09:50.519804 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.519717 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-qvd8f_5b883bf3-725a-4784-8b0c-9a2e5784b9f4/kuadrant-console-plugin/0.log" Jun 03 16:09:50.650226 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.650189 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-tqncd_2aeaa5ef-1d8b-4a17-a642-d7cc2451aaad/manager/0.log" Jun 03 16:09:50.743879 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:50.743852 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-j7cmb_463a9259-4ebf-4355-b464-3d4d276baff4/manager/0.log" Jun 03 16:09:53.342201 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:53.342166 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s62n4_d4433791-8d1d-4c6c-a8b9-1b34f832dccd/node-exporter/0.log" Jun 03 16:09:53.390754 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:53.390694 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s62n4_d4433791-8d1d-4c6c-a8b9-1b34f832dccd/kube-rbac-proxy/0.log" Jun 03 16:09:53.437424 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:53.437393 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s62n4_d4433791-8d1d-4c6c-a8b9-1b34f832dccd/init-textfile/0.log" Jun 03 16:09:53.483314 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:53.483286 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-xgttk_f19d54e8-e1bb-4f34-baaf-bcbb175cad1c/kube-rbac-proxy-main/0.log" Jun 03 16:09:53.542421 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:53.542364 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-xgttk_f19d54e8-e1bb-4f34-baaf-bcbb175cad1c/kube-rbac-proxy-self/0.log" Jun 03 16:09:53.584055 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:53.584022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-xgttk_f19d54e8-e1bb-4f34-baaf-bcbb175cad1c/openshift-state-metrics/0.log" Jun 03 16:09:53.998215 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:53.998147 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dj5v9_a1cd56cb-ccb2-46cd-97dd-b46248d33078/prometheus-operator/0.log" Jun 03 16:09:54.039065 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.039035 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dj5v9_a1cd56cb-ccb2-46cd-97dd-b46248d33078/kube-rbac-proxy/0.log" Jun 03 16:09:54.073772 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.073731 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-zfxvh_ac386a72-085f-4ce2-8246-ea4569f49800/prometheus-operator-admission-webhook/0.log" Jun 03 16:09:54.114418 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.114373 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8474cf9b59-qk685_b18ffc7a-390f-4b7f-8e3d-291836eea9d7/telemeter-client/0.log" Jun 03 16:09:54.157825 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.157790 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8474cf9b59-qk685_b18ffc7a-390f-4b7f-8e3d-291836eea9d7/reload/0.log" Jun 03 16:09:54.195664 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.195635 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8474cf9b59-qk685_b18ffc7a-390f-4b7f-8e3d-291836eea9d7/kube-rbac-proxy/0.log" Jun 03 16:09:54.235208 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.235181 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/thanos-query/0.log" Jun 03 16:09:54.286290 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.286184 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy-web/0.log" Jun 03 16:09:54.333013 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.332984 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy/0.log" Jun 03 16:09:54.378655 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.378624 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/prom-label-proxy/0.log" Jun 03 16:09:54.427775 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.427742 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy-rules/0.log" Jun 03 16:09:54.470582 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.470551 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c9444cff-vw7wb_f47fe03a-cce0-4dd3-bb77-a9c608108dc5/kube-rbac-proxy-metrics/0.log" Jun 03 16:09:54.562479 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.561373 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk"] Jun 03 16:09:54.565816 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.565785 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.582872 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.582843 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk"] Jun 03 16:09:54.606853 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.606801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-sys\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.607225 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.607187 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-lib-modules\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.607506 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.607487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-proc\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.607691 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.607660 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwgn\" (UniqueName: \"kubernetes.io/projected/899fef23-a86c-4b35-980d-d22f00f399cb-kube-api-access-lhwgn\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.607910 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.607893 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-podres\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709361 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709327 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-lib-modules\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709361 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709369 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-proc\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709621 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709393 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwgn\" (UniqueName: \"kubernetes.io/projected/899fef23-a86c-4b35-980d-d22f00f399cb-kube-api-access-lhwgn\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709621 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709442 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-podres\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709621 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709486 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-proc\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709621 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709500 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-sys\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709621 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709542 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-lib-modules\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709621 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709553 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-sys\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.709985 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.709640 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/899fef23-a86c-4b35-980d-d22f00f399cb-podres\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.723724 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.723686 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwgn\" (UniqueName: \"kubernetes.io/projected/899fef23-a86c-4b35-980d-d22f00f399cb-kube-api-access-lhwgn\") pod \"perf-node-gather-daemonset-lrjfk\" (UID: \"899fef23-a86c-4b35-980d-d22f00f399cb\") " pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:54.880549 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:54.880468 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:55.047607 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:55.047579 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk"] Jun 03 16:09:55.048713 ip-10-0-139-72 kubenswrapper[2582]: W0603 16:09:55.048681 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod899fef23_a86c_4b35_980d_d22f00f399cb.slice/crio-49b08cb63666f13bdfaccddb0aff0522c344c14daa8a9a097c7c48ef1cbe6ef5 WatchSource:0}: Error finding container 49b08cb63666f13bdfaccddb0aff0522c344c14daa8a9a097c7c48ef1cbe6ef5: Status 404 returned error can't find the container with id 49b08cb63666f13bdfaccddb0aff0522c344c14daa8a9a097c7c48ef1cbe6ef5 Jun 03 16:09:55.755132 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:55.755095 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" event={"ID":"899fef23-a86c-4b35-980d-d22f00f399cb","Type":"ContainerStarted","Data":"62a27d170d798a44fcd0be6affdbf485ab6d0eddaf9f9420692aaa3d3679911c"} Jun 03 16:09:55.755678 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:55.755655 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" event={"ID":"899fef23-a86c-4b35-980d-d22f00f399cb","Type":"ContainerStarted","Data":"49b08cb63666f13bdfaccddb0aff0522c344c14daa8a9a097c7c48ef1cbe6ef5"} Jun 03 16:09:55.755796 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:55.755784 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:09:55.783190 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:55.783138 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" podStartSLOduration=1.783120717 podStartE2EDuration="1.783120717s" podCreationTimestamp="2026-06-03 16:09:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:09:55.781601236 +0000 UTC m=+1252.377360934" watchObservedRunningTime="2026-06-03 16:09:55.783120717 +0000 UTC m=+1252.378880413" Jun 03 16:09:56.952411 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:56.952382 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59ff78b6df-llznx_f89716bb-e3dd-4c0f-9345-b8cc47a75346/console/0.log" Jun 03 16:09:58.827994 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:58.827969 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7dvm8_7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6/dns/0.log" Jun 03 16:09:58.872187 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:58.872161 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7dvm8_7b0a2b74-0ff3-45c9-9f1c-a40c2f0526a6/kube-rbac-proxy/0.log" Jun 03 16:09:59.013040 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:59.013004 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nz2nn_3b8787a4-9a3d-4633-815d-8bfea72d7d11/dns-node-resolver/0.log" Jun 03 16:09:59.815834 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:09:59.815798 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hvzs4_4d547784-0771-4962-8bd6-3978f1f12270/node-ca/0.log" Jun 03 16:10:01.284146 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:01.284110 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b7b64cc-cvfwg_67494cdc-037a-44d3-b5f7-81d917021dae/kube-auth-proxy/0.log" Jun 03 16:10:01.372661 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:01.372626 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-dmjzg_eede83b4-391a-4b42-9a36-7a8e19ecc37b/payload-processing/0.log" Jun 03 16:10:01.770801 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:01.770773 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpskt/perf-node-gather-daemonset-lrjfk" Jun 03 16:10:02.143398 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:02.143310 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bslbg_ff491c49-1d2d-4208-9aab-1a5a4c1626d1/serve-healthcheck-canary/0.log" Jun 03 16:10:02.896927 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:02.896898 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtkwt_f704e019-f289-4909-b76e-092c23f4bdd3/kube-rbac-proxy/0.log" Jun 03 16:10:02.937250 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:02.937185 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtkwt_f704e019-f289-4909-b76e-092c23f4bdd3/exporter/0.log" Jun 03 16:10:02.975920 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:02.975887 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtkwt_f704e019-f289-4909-b76e-092c23f4bdd3/extractor/0.log" Jun 03 16:10:06.135485 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:06.135439 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-mnf4k_e1d47d11-032d-40b1-8842-593dfab05cdf/manager/0.log" Jun 03 16:10:06.166011 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:06.165986 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58656688f4-mnf4k_e1d47d11-032d-40b1-8842-593dfab05cdf/copy-manifests/0.log" Jun 03 16:10:07.648218 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:07.648186 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-98789b7d5-llw4l_e9112736-779a-4c8c-9d12-21af4da88953/manager/0.log" Jun 03 16:10:07.731746 ip-10-0-139-72 kubenswrapper[2582]: I0603 16:10:07.731715 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-gpkwv_cb9b9ea8-7237-4bd9-b30c-3169bfc5a6ca/openshift-lws-operator/0.log"