Jun 02 02:45:23.794161 ip-10-0-139-87 systemd[1]: Starting Kubernetes Kubelet... Jun 02 02:45:24.234375 ip-10-0-139-87 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 02:45:24.234375 ip-10-0-139-87 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 02:45:24.234375 ip-10-0-139-87 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 02:45:24.234995 ip-10-0-139-87 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 02:45:24.234995 ip-10-0-139-87 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 02:45:24.237009 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.236921 2577 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 02:45:24.241853 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241838 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 02:45:24.241853 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241853 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241869 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241873 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241876 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241880 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241883 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241885 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241888 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241891 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241894 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241896 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241899 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241901 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241904 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241907 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241909 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241912 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241915 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241917 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241920 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 02:45:24.241934 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241923 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241925 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241927 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241930 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241932 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241935 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241938 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241941 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241944 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241947 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241950 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241959 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241962 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241965 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241967 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241971 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241973 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241976 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241978 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241981 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 02:45:24.242425 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241983 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241986 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241988 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241991 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241993 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241996 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.241998 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242000 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242003 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242005 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242008 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242010 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242013 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242019 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242022 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242025 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242028 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242030 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242033 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 02:45:24.242943 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242036 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242038 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242041 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242043 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242046 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242049 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242051 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242054 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242056 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242059 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242063 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242066 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242069 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242071 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242074 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242076 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242079 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242081 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242083 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242086 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 02:45:24.243403 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242088 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242091 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242094 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242096 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242098 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242102 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242505 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242512 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242516 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242519 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242522 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242525 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242528 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242531 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242534 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242536 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242539 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242543 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242547 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 02:45:24.243903 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242550 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242553 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242556 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242558 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242561 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242563 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242566 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242568 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242571 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242573 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242576 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242579 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242581 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242584 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242586 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242589 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242591 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242594 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242597 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242599 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 02:45:24.244371 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242603 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242605 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242608 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242610 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242612 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242615 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242618 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242621 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242623 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242626 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242628 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242631 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242634 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242636 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242638 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242641 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242643 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242646 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242648 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242651 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 02:45:24.244885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242653 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242656 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242658 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242662 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242664 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242667 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242669 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242671 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242674 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242677 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242679 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242682 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242685 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242687 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242690 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242693 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242695 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242698 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242701 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 02:45:24.245386 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242703 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242706 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242710 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242713 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242715 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242718 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242721 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242724 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242726 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242728 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242731 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242733 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242736 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.242738 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242808 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242815 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242821 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242825 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242829 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242833 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242837 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 02:45:24.245843 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242841 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242844 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242847 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242850 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242854 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242872 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242875 2577 flags.go:64] FLAG: --cgroup-root="" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242878 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242881 2577 flags.go:64] FLAG: --client-ca-file="" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242885 2577 flags.go:64] FLAG: --cloud-config="" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242887 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242890 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242898 2577 flags.go:64] FLAG: --cluster-domain="" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242900 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242904 2577 flags.go:64] FLAG: --config-dir="" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242906 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242910 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242920 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242924 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242927 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242930 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242933 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242936 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242939 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242942 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 02:45:24.246376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242945 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242949 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242952 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242956 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242959 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242962 2577 flags.go:64] FLAG: --enable-server="true" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242965 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242971 2577 flags.go:64] FLAG: --event-burst="100" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242974 2577 flags.go:64] FLAG: --event-qps="50" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242977 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242980 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242983 2577 flags.go:64] FLAG: --eviction-hard="" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242987 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242990 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242993 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242996 2577 flags.go:64] FLAG: --eviction-soft="" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.242999 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243002 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243004 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243007 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243010 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243013 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243016 2577 flags.go:64] FLAG: --feature-gates="" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243019 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243022 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 02:45:24.246981 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243031 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243034 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243037 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243040 2577 flags.go:64] FLAG: --help="false" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243043 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243046 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243049 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243052 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243055 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243058 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243061 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243064 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243066 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243069 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243072 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243075 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243078 2577 flags.go:64] FLAG: --kube-reserved="" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243081 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243086 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243089 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243092 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243094 2577 flags.go:64] FLAG: --lock-file="" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243097 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243100 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 02:45:24.247592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243103 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243108 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243111 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243114 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243117 2577 flags.go:64] FLAG: --logging-format="text" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243120 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243123 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243126 2577 flags.go:64] FLAG: --manifest-url="" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243129 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243134 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243137 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243141 2577 flags.go:64] FLAG: --max-pods="110" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243144 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243146 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243149 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243152 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243155 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243158 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243161 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243168 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243171 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243174 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243177 2577 flags.go:64] FLAG: --pod-cidr="" Jun 02 02:45:24.248225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243180 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243185 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243188 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243191 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243196 2577 flags.go:64] FLAG: --port="10250" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243199 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243202 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c3e1c4aec0b8b23a" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243205 2577 flags.go:64] FLAG: --qos-reserved="" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243208 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243211 2577 flags.go:64] FLAG: --register-node="true" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243213 2577 flags.go:64] FLAG: --register-schedulable="true" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243216 2577 flags.go:64] FLAG: --register-with-taints="" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243224 2577 flags.go:64] FLAG: --registry-burst="10" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243228 2577 flags.go:64] FLAG: --registry-qps="5" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243231 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243233 2577 flags.go:64] FLAG: --reserved-memory="" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243237 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243240 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243243 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243246 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243249 2577 flags.go:64] FLAG: --runonce="false" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243252 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243255 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243258 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243261 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243263 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 02:45:24.248807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243266 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243271 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243274 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243277 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243280 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243282 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243285 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243288 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243291 2577 flags.go:64] FLAG: --system-cgroups="" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243294 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243301 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243303 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243306 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243311 2577 flags.go:64] FLAG: --tls-min-version="" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243314 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243317 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243320 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243322 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243325 2577 flags.go:64] FLAG: --v="2" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243329 2577 flags.go:64] FLAG: --version="false" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243333 2577 flags.go:64] FLAG: --vmodule="" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243337 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.243340 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243441 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 02:45:24.249515 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243445 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243448 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243456 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243460 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243462 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243465 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243467 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243470 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243473 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243477 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243480 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243483 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243485 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243488 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243492 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243495 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243499 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243502 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243506 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243508 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 02:45:24.250526 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243511 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243514 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243516 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243518 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243521 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243523 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243526 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243529 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243532 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243534 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243537 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243539 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243542 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243544 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243547 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243552 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243555 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243558 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243561 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 02:45:24.251183 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243563 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243566 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243570 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243572 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243575 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243577 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243580 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243582 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243585 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243588 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243590 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243594 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243597 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243600 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243603 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243605 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243608 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243610 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243613 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243615 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 02:45:24.251698 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243618 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243620 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243623 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243625 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243628 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243630 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243633 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243636 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243638 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243641 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243644 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243647 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243649 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243652 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243655 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243658 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243660 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243663 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243665 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243668 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 02 02:45:24.252210 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243670 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243673 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243675 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243680 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243682 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.243685 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.244296 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.251970 2577 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.251987 2577 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252047 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252052 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252055 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252059 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252061 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252064 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252067 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 02:45:24.252694 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252070 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252073 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252076 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252078 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252081 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252084 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252086 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252089 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252092 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252094 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252097 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252100 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252102 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252105 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252108 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252110 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252114 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252118 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252121 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 02:45:24.253132 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252124 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252126 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252129 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252132 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252136 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252138 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252141 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252144 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252146 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252149 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252151 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252154 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252157 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252160 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252162 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252165 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252167 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252170 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252172 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252175 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 02:45:24.253605 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252177 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252180 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252182 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252185 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252188 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252192 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252197 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252200 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252203 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252206 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252209 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252212 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252215 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252218 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252221 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252224 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252228 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252231 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252234 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 02:45:24.254150 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252236 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252239 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252241 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252244 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252247 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252249 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252252 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252254 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252257 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252259 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252262 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252265 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252268 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252270 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252273 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252275 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252278 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252281 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252284 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252286 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 02:45:24.254611 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252289 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.252293 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252384 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252389 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252392 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252395 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252398 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252400 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252403 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252407 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252409 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252412 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252415 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252418 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252421 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 02:45:24.255111 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252423 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252426 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252428 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252431 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252433 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252436 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252439 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252441 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252444 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252447 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252450 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252453 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252456 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252458 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252461 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252464 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252466 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252469 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252471 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252474 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 02:45:24.255483 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252476 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252479 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252482 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252484 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252486 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252489 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252492 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252494 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252497 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252500 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252504 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252507 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252510 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252512 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252515 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252518 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252520 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252523 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252525 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 02:45:24.255986 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252528 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252530 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252532 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252536 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252539 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252541 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252544 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252546 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252549 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252551 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252554 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252557 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252560 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252562 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252565 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252567 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252570 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252572 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252575 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252578 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 02:45:24.256457 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252580 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252584 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252587 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252590 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252592 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252595 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252597 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252600 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252603 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252605 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252608 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252610 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252613 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:24.252615 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.252620 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 02:45:24.256993 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.253498 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 02:45:24.257415 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.256601 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 02:45:24.257548 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.257536 2577 server.go:1019] "Starting client certificate rotation" Jun 02 02:45:24.257686 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.257668 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 02:45:24.257746 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.257717 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 02:45:24.282323 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.282306 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 02:45:24.284394 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.284380 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 02:45:24.298533 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.298516 2577 log.go:25] "Validated CRI v1 runtime API" Jun 02 02:45:24.304954 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.304938 2577 log.go:25] "Validated CRI v1 image API" Jun 02 02:45:24.306797 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.306777 2577 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 02:45:24.309808 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.309786 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ba8c397f-45d2-4347-84c9-9194cdf51efe:/dev/nvme0n1p3 dbb91b34-670a-404b-a04f-651743521ad7:/dev/nvme0n1p4] Jun 02 02:45:24.309906 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.309805 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 02:45:24.314425 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.314314 2577 manager.go:217] Machine: {Timestamp:2026-06-02 02:45:24.31380235 +0000 UTC m=+0.406336672 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093482 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29d1568f3bb37e89c1bbde6d437a6e SystemUUID:ec29d156-8f3b-b37e-89c1-bbde6d437a6e BootID:b68384f3-6c5a-472a-89f4-311fc6ec9958 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:66:08:a0:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:66:08:a0:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:d1:11:be:c9:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 02:45:24.315094 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.315081 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 02:45:24.315194 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.315180 2577 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 02:45:24.315564 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.315548 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 02:45:24.318474 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.318450 2577 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 02:45:24.318607 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.318477 2577 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 02:45:24.318653 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.318616 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 02:45:24.318653 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.318625 2577 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 02:45:24.318653 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.318632 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 02:45:24.319303 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.319293 2577 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 02:45:24.320186 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.320176 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 02 02:45:24.320296 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.320287 2577 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 02:45:24.322458 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.322449 2577 kubelet.go:491] "Attempting to sync node with API server" Jun 02 02:45:24.322498 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.322467 2577 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 02:45:24.322498 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.322477 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 02:45:24.322498 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.322486 2577 kubelet.go:397] "Adding apiserver pod source" Jun 02 02:45:24.322498 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.322495 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 02:45:24.323595 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.323583 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 02:45:24.323660 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.323601 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 02:45:24.327296 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.327280 2577 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 02:45:24.329262 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.329248 2577 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 02:45:24.331468 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331454 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 02:45:24.331468 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331471 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331477 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331482 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331493 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331502 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331510 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331517 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331523 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331531 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331548 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 02:45:24.331554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.331553 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 02:45:24.332546 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.332531 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 02:45:24.332546 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.332547 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 02:45:24.334730 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.334706 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 02:45:24.334801 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.334751 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 02:45:24.336646 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.336633 2577 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 02:45:24.336698 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.336668 2577 server.go:1295] "Started kubelet" Jun 02 02:45:24.337439 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.336717 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 02:45:24.337688 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.337664 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6dm8k" Jun 02 02:45:24.337982 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.337940 2577 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 02:45:24.338030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.338004 2577 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 02:45:24.338361 ip-10-0-139-87 systemd[1]: Started Kubernetes Kubelet. Jun 02 02:45:24.339682 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.339400 2577 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 02:45:24.341739 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.341723 2577 server.go:317] "Adding debug handlers to kubelet server" Jun 02 02:45:24.344174 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.344139 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 02:45:24.344264 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.344242 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 02:45:24.344518 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.344497 2577 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 02:45:24.344518 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.344517 2577 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 02:45:24.344680 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.344667 2577 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 02:45:24.344761 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.344744 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 02 02:45:24.344811 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.344764 2577 reconciler.go:26] "Reconciler: start to sync state" Jun 02 02:45:24.345789 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.345772 2577 factory.go:55] Registering systemd factory Jun 02 02:45:24.345789 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.345791 2577 factory.go:223] Registration of the systemd container factory successfully Jun 02 02:45:24.346405 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.346323 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:24.346482 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.346412 2577 factory.go:153] Registering CRI-O factory Jun 02 02:45:24.346482 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.346429 2577 factory.go:223] Registration of the crio container factory successfully Jun 02 02:45:24.346482 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.346463 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6dm8k" Jun 02 02:45:24.346482 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.346481 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 02:45:24.346674 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.346499 2577 factory.go:103] Registering Raw factory Jun 02 02:45:24.346674 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.346515 2577 manager.go:1196] Started watching for new ooms in manager Jun 02 02:45:24.347038 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.347026 2577 manager.go:319] Starting recovery of all containers Jun 02 02:45:24.347247 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.347231 2577 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 02:45:24.347534 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.347504 2577 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 02:45:24.347744 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.347728 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 02:45:24.347831 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.347816 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 02:45:24.348210 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.347272 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-87.ec2.internal.18b5238ee571760c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-87.ec2.internal,UID:ip-10-0-139-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-87.ec2.internal,},FirstTimestamp:2026-06-02 02:45:24.336645644 +0000 UTC m=+0.429179953,LastTimestamp:2026-06-02 02:45:24.336645644 +0000 UTC m=+0.429179953,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-87.ec2.internal,}" Jun 02 02:45:24.356667 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.356507 2577 manager.go:324] Recovery completed Jun 02 02:45:24.361129 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.361116 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 02:45:24.362773 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.362758 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientMemory" Jun 02 02:45:24.362837 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.362783 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 02:45:24.362837 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.362793 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientPID" Jun 02 02:45:24.363360 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.363347 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 02:45:24.363360 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.363358 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 02:45:24.363440 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.363375 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 02 02:45:24.365995 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.365984 2577 policy_none.go:49] "None policy: Start" Jun 02 02:45:24.366030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.366000 2577 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 02:45:24.366030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.366010 2577 state_mem.go:35] "Initializing new in-memory state store" Jun 02 02:45:24.391426 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.391408 2577 manager.go:341] "Starting Device Plugin manager" Jun 02 02:45:24.391508 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.391436 2577 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 02:45:24.391508 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.391445 2577 server.go:85] "Starting device plugin registration server" Jun 02 02:45:24.391670 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.391658 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 02:45:24.391728 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.391671 2577 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 02:45:24.391774 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.391754 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 02:45:24.391844 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.391830 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 02:45:24.391896 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.391845 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 02:45:24.392404 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.392388 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 02:45:24.392468 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.392420 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:24.438907 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.438887 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 02:45:24.440015 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.439994 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 02:45:24.440083 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.440018 2577 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 02:45:24.440083 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.440034 2577 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 02:45:24.440083 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.440041 2577 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 02:45:24.440083 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.440079 2577 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 02:45:24.442816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.442801 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 02:45:24.492847 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.492802 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 02:45:24.493566 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.493552 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientMemory" Jun 02 02:45:24.493629 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.493581 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 02:45:24.493629 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.493593 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientPID" Jun 02 02:45:24.493629 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.493614 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.503405 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.503388 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.503448 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.503409 2577 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-87.ec2.internal\": node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:24.520739 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.520721 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:24.540906 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.540889 2577 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal"] Jun 02 02:45:24.540959 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.540943 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 02:45:24.541604 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.541591 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientMemory" Jun 02 02:45:24.541662 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.541617 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 02:45:24.541662 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.541627 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientPID" Jun 02 02:45:24.542855 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.542844 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 02:45:24.543024 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543009 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.543068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543039 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 02:45:24.543492 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543476 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientMemory" Jun 02 02:45:24.543492 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543483 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientMemory" Jun 02 02:45:24.543584 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543502 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 02:45:24.543584 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543518 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientPID" Jun 02 02:45:24.543584 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543506 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 02:45:24.543688 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.543585 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientPID" Jun 02 02:45:24.544715 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.544700 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.544755 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.544732 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 02:45:24.545367 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.545346 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientMemory" Jun 02 02:45:24.545451 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.545372 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 02:45:24.545451 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.545387 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeHasSufficientPID" Jun 02 02:45:24.545659 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.545632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f28e4ed091d830f86982f1afbe58a639-config\") pod \"kube-apiserver-proxy-ip-10-0-139-87.ec2.internal\" (UID: \"f28e4ed091d830f86982f1afbe58a639\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.545709 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.545668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e2c86f3b29c058e3b6fb1c92fc6cd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal\" (UID: \"56e2c86f3b29c058e3b6fb1c92fc6cd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.545709 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.545684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e2c86f3b29c058e3b6fb1c92fc6cd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal\" (UID: \"56e2c86f3b29c058e3b6fb1c92fc6cd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.571404 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.571385 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-87.ec2.internal\" not found" node="ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.575568 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.575553 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-87.ec2.internal\" not found" node="ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.621693 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.621676 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:24.646656 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.646639 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e2c86f3b29c058e3b6fb1c92fc6cd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal\" (UID: \"56e2c86f3b29c058e3b6fb1c92fc6cd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.646724 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.646661 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e2c86f3b29c058e3b6fb1c92fc6cd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal\" (UID: \"56e2c86f3b29c058e3b6fb1c92fc6cd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.646724 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.646680 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f28e4ed091d830f86982f1afbe58a639-config\") pod \"kube-apiserver-proxy-ip-10-0-139-87.ec2.internal\" (UID: \"f28e4ed091d830f86982f1afbe58a639\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.646724 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.646721 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f28e4ed091d830f86982f1afbe58a639-config\") pod \"kube-apiserver-proxy-ip-10-0-139-87.ec2.internal\" (UID: \"f28e4ed091d830f86982f1afbe58a639\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.646848 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.646751 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e2c86f3b29c058e3b6fb1c92fc6cd0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal\" (UID: \"56e2c86f3b29c058e3b6fb1c92fc6cd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.646848 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.646760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e2c86f3b29c058e3b6fb1c92fc6cd0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal\" (UID: \"56e2c86f3b29c058e3b6fb1c92fc6cd0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.722255 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.722235 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:24.822853 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.822791 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:24.873380 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.873356 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.879241 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:24.879226 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" Jun 02 02:45:24.923935 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:24.923902 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.024426 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.024397 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.124967 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.124896 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.225418 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.225384 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.257885 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.257845 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 02:45:25.258384 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.258016 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 02:45:25.326380 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.326350 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.345554 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.345531 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 02:45:25.347919 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.347885 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 02:40:24 +0000 UTC" deadline="2027-11-16 17:30:15.882211468 +0000 UTC" Jun 02 02:45:25.347976 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.347918 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12782h44m50.534295759s" Jun 02 02:45:25.362307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.362286 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 02:45:25.378689 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:25.378620 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28e4ed091d830f86982f1afbe58a639.slice/crio-8164a8bc97216de1f02f6921ddbf709506f9c2b4dfce281e1f23e0ca522041bb WatchSource:0}: Error finding container 8164a8bc97216de1f02f6921ddbf709506f9c2b4dfce281e1f23e0ca522041bb: Status 404 returned error can't find the container with id 8164a8bc97216de1f02f6921ddbf709506f9c2b4dfce281e1f23e0ca522041bb Jun 02 02:45:25.378893 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:25.378872 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e2c86f3b29c058e3b6fb1c92fc6cd0.slice/crio-b7fd089008cb32fb30690d0a5fe7dbc8a91c2260653fdff206d926dd69cd0b73 WatchSource:0}: Error finding container b7fd089008cb32fb30690d0a5fe7dbc8a91c2260653fdff206d926dd69cd0b73: Status 404 returned error can't find the container with id b7fd089008cb32fb30690d0a5fe7dbc8a91c2260653fdff206d926dd69cd0b73 Jun 02 02:45:25.382082 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.382066 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:45:25.384668 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.384652 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbq6l" Jun 02 02:45:25.392500 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.392480 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbq6l" Jun 02 02:45:25.426813 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.426792 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.438562 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.438544 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 02:45:25.442723 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.442691 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" event={"ID":"f28e4ed091d830f86982f1afbe58a639","Type":"ContainerStarted","Data":"8164a8bc97216de1f02f6921ddbf709506f9c2b4dfce281e1f23e0ca522041bb"} Jun 02 02:45:25.443487 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.443469 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" event={"ID":"56e2c86f3b29c058e3b6fb1c92fc6cd0","Type":"ContainerStarted","Data":"b7fd089008cb32fb30690d0a5fe7dbc8a91c2260653fdff206d926dd69cd0b73"} Jun 02 02:45:25.527043 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.527019 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.627529 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.627499 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.728010 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.727984 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.828814 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:25.828775 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-87.ec2.internal\" not found" Jun 02 02:45:25.872840 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.872815 2577 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 02:45:25.931493 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.930423 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 02:45:25.945743 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.945713 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" Jun 02 02:45:25.955963 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.955934 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 02:45:25.956999 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.956977 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" Jun 02 02:45:25.965214 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:25.965181 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 02:45:26.323417 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.323388 2577 apiserver.go:52] "Watching apiserver" Jun 02 02:45:26.330099 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.330077 2577 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 02:45:26.330454 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.330432 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal","openshift-image-registry/node-ca-s274b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal","openshift-multus/multus-additional-cni-plugins-vt4vr","openshift-network-diagnostics/network-check-target-qbgkr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv","openshift-cluster-node-tuning-operator/tuned-pt6th","openshift-dns/node-resolver-fbr8w","openshift-multus/multus-k9hqx","openshift-multus/network-metrics-daemon-69mdd","openshift-network-operator/iptables-alerter-8cd6w","openshift-ovn-kubernetes/ovnkube-node-pw6lq","kube-system/konnectivity-agent-226xq"] Jun 02 02:45:26.332929 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.332906 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.334183 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.334143 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.334287 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.334254 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.335292 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.335270 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:45:26.335377 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.335346 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wkpx2\"" Jun 02 02:45:26.335432 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.335353 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 02:45:26.336535 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.336507 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c6d95\"" Jun 02 02:45:26.336829 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.336742 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 02:45:26.336997 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.336978 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 02:45:26.337203 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337075 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 02:45:26.337203 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337103 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 02:45:26.337815 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337416 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:26.337815 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.337495 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:26.337815 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337557 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.337815 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337625 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m86qz\"" Jun 02 02:45:26.337815 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337751 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 02:45:26.337815 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337799 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 02:45:26.338169 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.337979 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 02:45:26.338169 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.338070 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 02:45:26.338819 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.338724 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.339791 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.339767 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 02:45:26.339910 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.339820 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 02:45:26.340255 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.340123 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.340255 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.340138 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pqbcw\"" Jun 02 02:45:26.340721 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.340328 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 02:45:26.341472 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.341453 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 02:45:26.341621 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.341607 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 02:45:26.341797 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.341774 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f4q6l\"" Jun 02 02:45:26.342567 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.342457 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 02:45:26.342830 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.342813 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m2wb6\"" Jun 02 02:45:26.345054 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.345035 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:26.345156 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.345103 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.345156 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.345103 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:26.346987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.346970 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.347489 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.347462 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:45:26.347489 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.347478 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 02:45:26.347628 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.347566 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 02:45:26.347719 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.347699 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pvzbp\"" Jun 02 02:45:26.349009 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.348983 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.349496 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.349478 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 02:45:26.349567 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.349481 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 02:45:26.350631 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.350611 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 02:45:26.350713 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.350676 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 02:45:26.350771 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.350713 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 02:45:26.350822 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.350794 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 02:45:26.350822 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.350813 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cbw5t\"" Jun 02 02:45:26.351192 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.351172 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 02:45:26.351291 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.351277 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 02:45:26.351349 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.351277 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kctnl\"" Jun 02 02:45:26.356264 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2wtd\" (UniqueName: \"kubernetes.io/projected/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-kube-api-access-m2wtd\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.356362 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cnibin\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.356362 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.356455 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-cnibin\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.356455 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-iptables-alerter-script\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.356541 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysctl-d\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.356541 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-sys\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.356541 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abe048da-2772-46b7-a0a5-7584ae6973a8-tmp\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.356541 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-conf-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.356678 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50004b00-43fb-4069-96df-172af5344eb8-multus-daemon-config\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.356678 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-os-release\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.356678 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-kubelet\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.356678 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-systemd\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.356678 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-registration-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.356678 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:26.356914 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-netns\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.356914 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-socket-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.356914 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-cni-bin\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.356914 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-run\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.356914 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:26.356914 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5ff513-a73b-44c9-bc56-e36cd25812cf-tmp-dir\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-socket-dir-parent\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.356981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-multus-certs\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-etc-kubernetes\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-kubernetes\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-lib-modules\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-host\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz8np\" (UniqueName: \"kubernetes.io/projected/a8a9d063-a2aa-4ced-b911-f081f70fd46c-kube-api-access-jz8np\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.357146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-system-cni-dir\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-system-cni-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-cni-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdk2g\" (UniqueName: \"kubernetes.io/projected/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-kube-api-access-rdk2g\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-sys-fs\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc5ff513-a73b-44c9-bc56-e36cd25812cf-hosts-file\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbf4\" (UniqueName: \"kubernetes.io/projected/51ff4c93-dadf-4a56-9e65-645b1123c885-kube-api-access-qpbf4\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phnfz\" (UniqueName: \"kubernetes.io/projected/fbc63c29-97cc-47e3-bf26-130f852a9b5e-kube-api-access-phnfz\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ts98\" (UniqueName: \"kubernetes.io/projected/50004b00-43fb-4069-96df-172af5344eb8-kube-api-access-8ts98\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-host-slash\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-tuned\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-hostroot\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysctl-conf\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.357544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-modprobe-d\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-var-lib-kubelet\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50004b00-43fb-4069-96df-172af5344eb8-cni-binary-copy\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysconfig\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgk7\" (UniqueName: \"kubernetes.io/projected/bc5ff513-a73b-44c9-bc56-e36cd25812cf-kube-api-access-gpgk7\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-device-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-host\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-os-release\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7j6z\" (UniqueName: \"kubernetes.io/projected/abe048da-2772-46b7-a0a5-7584ae6973a8-kube-api-access-n7j6z\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-cni-multus\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-serviceca\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.358052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.357998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-k8s-cni-cncf-io\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.393065 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.393037 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 02:40:25 +0000 UTC" deadline="2028-01-07 10:33:34.559492804 +0000 UTC" Jun 02 02:45:26.393146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.393065 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14023h48m8.166430946s" Jun 02 02:45:26.399030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.398971 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 02:45:26.445815 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.445792 2577 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 02:45:26.458933 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.458880 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.459069 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.458946 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-device-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.459069 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.458978 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-host\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.459069 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459005 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.459069 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.459069 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459032 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-os-release\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459069 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459057 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7j6z\" (UniqueName: \"kubernetes.io/projected/abe048da-2772-46b7-a0a5-7584ae6973a8-kube-api-access-n7j6z\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-device-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-node-log\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459116 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-host\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459123 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-cni-multus\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-os-release\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-etc-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459192 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-serviceca\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-cni-multus\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459357 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459265 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-k8s-cni-cncf-io\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459374 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-k8s-cni-cncf-io\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-slash\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459421 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2wtd\" (UniqueName: \"kubernetes.io/projected/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-kube-api-access-m2wtd\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459483 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cnibin\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459516 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459541 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-cnibin\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459545 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cnibin\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459562 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-iptables-alerter-script\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459722 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-cnibin\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.459792 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459730 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysctl-d\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459810 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-sys\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459875 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abe048da-2772-46b7-a0a5-7584ae6973a8-tmp\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459887 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysctl-d\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-sys\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-systemd\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-var-lib-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-env-overrides\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.459997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460002 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-conf-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460026 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50004b00-43fb-4069-96df-172af5344eb8-multus-daemon-config\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460051 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-os-release\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-conf-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460093 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-kubelet\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460117 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-systemd\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460123 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-iptables-alerter-script\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-os-release\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460141 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-registration-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.460328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460184 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-systemd\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460208 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-kubelet\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-kubelet\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-registration-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460262 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-netns\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.460310 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460312 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-socket-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.460389 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:26.960358921 +0000 UTC m=+3.052893235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-socket-dir\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovn-node-metrics-cert\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-netns\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460450 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ccb4fd09-dd0c-4d09-8d05-ff0c775360d9-konnectivity-ca\") pod \"konnectivity-agent-226xq\" (UID: \"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9\") " pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460486 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-cni-bin\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-var-lib-cni-bin\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460534 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-run\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.461057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460563 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-run\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460619 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50004b00-43fb-4069-96df-172af5344eb8-multus-daemon-config\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460611 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5ff513-a73b-44c9-bc56-e36cd25812cf-tmp-dir\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460742 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460825 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-socket-dir-parent\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460887 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460888 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-multus-certs\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460921 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-etc-kubernetes\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-host-run-multus-certs\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-serviceca\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc5ff513-a73b-44c9-bc56-e36cd25812cf-tmp-dir\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-socket-dir-parent\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.460986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-etc-kubernetes\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461018 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-kubernetes\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461042 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-lib-modules\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461067 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-host\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-kubernetes\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.461806 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461104 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8np\" (UniqueName: \"kubernetes.io/projected/a8a9d063-a2aa-4ced-b911-f081f70fd46c-kube-api-access-jz8np\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461131 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-system-cni-dir\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461155 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-system-cni-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-host\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461177 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-lib-modules\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbc63c29-97cc-47e3-bf26-130f852a9b5e-system-cni-dir\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461213 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-cni-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcg52\" (UniqueName: \"kubernetes.io/projected/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-kube-api-access-rcg52\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-system-cni-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-multus-cni-dir\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461285 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdk2g\" (UniqueName: \"kubernetes.io/projected/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-kube-api-access-rdk2g\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-systemd-units\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-run-netns\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovnkube-config\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461419 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-sys-fs\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461438 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc5ff513-a73b-44c9-bc56-e36cd25812cf-hosts-file\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461459 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbf4\" (UniqueName: \"kubernetes.io/projected/51ff4c93-dadf-4a56-9e65-645b1123c885-kube-api-access-qpbf4\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:26.462596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-sys-fs\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc5ff513-a73b-44c9-bc56-e36cd25812cf-hosts-file\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461639 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phnfz\" (UniqueName: \"kubernetes.io/projected/fbc63c29-97cc-47e3-bf26-130f852a9b5e-kube-api-access-phnfz\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461655 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ts98\" (UniqueName: \"kubernetes.io/projected/50004b00-43fb-4069-96df-172af5344eb8-kube-api-access-8ts98\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461672 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-host-slash\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461688 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-tuned\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-cni-netd\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovnkube-script-lib\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-host-slash\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ccb4fd09-dd0c-4d09-8d05-ff0c775360d9-agent-certs\") pod \"konnectivity-agent-226xq\" (UID: \"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9\") " pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461804 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-hostroot\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461829 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysctl-conf\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461853 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461891 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50004b00-43fb-4069-96df-172af5344eb8-hostroot\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-ovn\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-log-socket\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.463345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461968 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-modprobe-d\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8a9d063-a2aa-4ced-b911-f081f70fd46c-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.461994 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-var-lib-kubelet\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysctl-conf\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-var-lib-kubelet\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462039 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462077 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50004b00-43fb-4069-96df-172af5344eb8-cni-binary-copy\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462101 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysconfig\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-modprobe-d\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462126 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgk7\" (UniqueName: \"kubernetes.io/projected/bc5ff513-a73b-44c9-bc56-e36cd25812cf-kube-api-access-gpgk7\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-run-ovn-kubernetes\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-cni-bin\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-sysconfig\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.462657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50004b00-43fb-4069-96df-172af5344eb8-cni-binary-copy\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.463120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbc63c29-97cc-47e3-bf26-130f852a9b5e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.463694 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abe048da-2772-46b7-a0a5-7584ae6973a8-tmp\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.464016 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.463945 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/abe048da-2772-46b7-a0a5-7584ae6973a8-etc-tuned\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.467135 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.467113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7j6z\" (UniqueName: \"kubernetes.io/projected/abe048da-2772-46b7-a0a5-7584ae6973a8-kube-api-access-n7j6z\") pod \"tuned-pt6th\" (UID: \"abe048da-2772-46b7-a0a5-7584ae6973a8\") " pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.470041 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.470019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2wtd\" (UniqueName: \"kubernetes.io/projected/bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb-kube-api-access-m2wtd\") pod \"node-ca-s274b\" (UID: \"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb\") " pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.472925 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.472516 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 02:45:26.472925 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.472538 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 02:45:26.472925 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.472552 2577 projected.go:194] Error preparing data for projected volume kube-api-access-vnvfn for pod openshift-network-diagnostics/network-check-target-qbgkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:26.472925 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.472618 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn podName:12a1ec12-6a72-4e51-9345-4ac5406ec62f nodeName:}" failed. No retries permitted until 2026-06-02 02:45:26.972600389 +0000 UTC m=+3.065134687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvfn" (UniqueName: "kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn") pod "network-check-target-qbgkr" (UID: "12a1ec12-6a72-4e51-9345-4ac5406ec62f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:26.474921 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.474898 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phnfz\" (UniqueName: \"kubernetes.io/projected/fbc63c29-97cc-47e3-bf26-130f852a9b5e-kube-api-access-phnfz\") pod \"multus-additional-cni-plugins-vt4vr\" (UID: \"fbc63c29-97cc-47e3-bf26-130f852a9b5e\") " pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.476280 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.475476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbf4\" (UniqueName: \"kubernetes.io/projected/51ff4c93-dadf-4a56-9e65-645b1123c885-kube-api-access-qpbf4\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:26.477887 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.476657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ts98\" (UniqueName: \"kubernetes.io/projected/50004b00-43fb-4069-96df-172af5344eb8-kube-api-access-8ts98\") pod \"multus-k9hqx\" (UID: \"50004b00-43fb-4069-96df-172af5344eb8\") " pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.478322 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.478251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdk2g\" (UniqueName: \"kubernetes.io/projected/c7ee1cf9-748d-4d8b-b891-73d03814ebcd-kube-api-access-rdk2g\") pod \"iptables-alerter-8cd6w\" (UID: \"c7ee1cf9-748d-4d8b-b891-73d03814ebcd\") " pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.479043 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.479020 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz8np\" (UniqueName: \"kubernetes.io/projected/a8a9d063-a2aa-4ced-b911-f081f70fd46c-kube-api-access-jz8np\") pod \"aws-ebs-csi-driver-node-4hsmv\" (UID: \"a8a9d063-a2aa-4ced-b911-f081f70fd46c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.480187 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.480166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgk7\" (UniqueName: \"kubernetes.io/projected/bc5ff513-a73b-44c9-bc56-e36cd25812cf-kube-api-access-gpgk7\") pod \"node-resolver-fbr8w\" (UID: \"bc5ff513-a73b-44c9-bc56-e36cd25812cf\") " pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.563088 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563057 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-systemd\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563088 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563094 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-var-lib-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563311 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563118 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-env-overrides\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563311 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-systemd\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563311 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563191 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-var-lib-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563311 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563244 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-kubelet\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563311 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563293 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovn-node-metrics-cert\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563315 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ccb4fd09-dd0c-4d09-8d05-ff0c775360d9-konnectivity-ca\") pod \"konnectivity-agent-226xq\" (UID: \"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9\") " pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563330 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-kubelet\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563359 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcg52\" (UniqueName: \"kubernetes.io/projected/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-kube-api-access-rcg52\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563383 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-systemd-units\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563407 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-run-netns\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563430 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovnkube-config\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563459 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563485 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-cni-netd\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563510 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovnkube-script-lib\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563533 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ccb4fd09-dd0c-4d09-8d05-ff0c775360d9-agent-certs\") pod \"konnectivity-agent-226xq\" (UID: \"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9\") " pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.563549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-run-netns\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563559 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-ovn\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563593 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-log-socket\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-ovn\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563627 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-run-ovn-kubernetes\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-env-overrides\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-cni-netd\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563688 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-systemd-units\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563711 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-cni-bin\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-log-socket\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-cni-bin\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-run-ovn-kubernetes\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563827 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-node-log\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563855 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-etc-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563900 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-slash\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-node-log\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-etc-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.564068 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ccb4fd09-dd0c-4d09-8d05-ff0c775360d9-konnectivity-ca\") pod \"konnectivity-agent-226xq\" (UID: \"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9\") " pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.565122 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563933 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.565122 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.563979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-run-openvswitch\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.565122 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.564036 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-host-slash\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.565122 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.564107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovnkube-config\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.565122 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.564245 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovnkube-script-lib\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.566194 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.566167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ccb4fd09-dd0c-4d09-8d05-ff0c775360d9-agent-certs\") pod \"konnectivity-agent-226xq\" (UID: \"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9\") " pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.566283 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.566242 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-ovn-node-metrics-cert\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.571678 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.571658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcg52\" (UniqueName: \"kubernetes.io/projected/2fd00cdc-f46d-41b8-b401-ade2e3585ca9-kube-api-access-rcg52\") pod \"ovnkube-node-pw6lq\" (UID: \"2fd00cdc-f46d-41b8-b401-ade2e3585ca9\") " pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.645596 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.645526 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pt6th" Jun 02 02:45:26.652279 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.652253 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s274b" Jun 02 02:45:26.659837 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.659821 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" Jun 02 02:45:26.664573 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.664553 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" Jun 02 02:45:26.672123 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.672106 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fbr8w" Jun 02 02:45:26.679302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.679283 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9hqx" Jun 02 02:45:26.686766 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.686738 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8cd6w" Jun 02 02:45:26.693376 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.693358 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:26.700845 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.700830 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:26.921272 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.921235 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50004b00_43fb_4069_96df_172af5344eb8.slice/crio-3d55fa46484b83284f05d9976350a96d2ce47c57e83dbbf26079698f2c0b3a14 WatchSource:0}: Error finding container 3d55fa46484b83284f05d9976350a96d2ce47c57e83dbbf26079698f2c0b3a14: Status 404 returned error can't find the container with id 3d55fa46484b83284f05d9976350a96d2ce47c57e83dbbf26079698f2c0b3a14 Jun 02 02:45:26.922463 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.922423 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc63c29_97cc_47e3_bf26_130f852a9b5e.slice/crio-a5faa8f13d8840b8bad5a0ed1c2d814e8d36bf095d0e5f60e66a56d3ac838feb WatchSource:0}: Error finding container a5faa8f13d8840b8bad5a0ed1c2d814e8d36bf095d0e5f60e66a56d3ac838feb: Status 404 returned error can't find the container with id a5faa8f13d8840b8bad5a0ed1c2d814e8d36bf095d0e5f60e66a56d3ac838feb Jun 02 02:45:26.925617 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.925596 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5ff513_a73b_44c9_bc56_e36cd25812cf.slice/crio-a21cf9d854143609abcf048886fb855d7dedaffa42f093e8676c3bc455b5e6ab WatchSource:0}: Error finding container a21cf9d854143609abcf048886fb855d7dedaffa42f093e8676c3bc455b5e6ab: Status 404 returned error can't find the container with id a21cf9d854143609abcf048886fb855d7dedaffa42f093e8676c3bc455b5e6ab Jun 02 02:45:26.926444 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.926416 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe048da_2772_46b7_a0a5_7584ae6973a8.slice/crio-bbc3515ea91e16c955d4d887e9950a4bdddbb77b290cf5ece868ceda6ddfebab WatchSource:0}: Error finding container bbc3515ea91e16c955d4d887e9950a4bdddbb77b290cf5ece868ceda6ddfebab: Status 404 returned error can't find the container with id bbc3515ea91e16c955d4d887e9950a4bdddbb77b290cf5ece868ceda6ddfebab Jun 02 02:45:26.927429 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.927405 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ee1cf9_748d_4d8b_b891_73d03814ebcd.slice/crio-4e73e3e0518645f97f29e432caeb9e82ac3e3bd3552b449f1bb17c34a28895a5 WatchSource:0}: Error finding container 4e73e3e0518645f97f29e432caeb9e82ac3e3bd3552b449f1bb17c34a28895a5: Status 404 returned error can't find the container with id 4e73e3e0518645f97f29e432caeb9e82ac3e3bd3552b449f1bb17c34a28895a5 Jun 02 02:45:26.928521 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.928498 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd57cd98_c9ce_409b_b22b_3f73fd9d9dfb.slice/crio-fb02442ecba6327d62a2ea40c79b307462672455ec0d07fb508268ea7f9ad395 WatchSource:0}: Error finding container fb02442ecba6327d62a2ea40c79b307462672455ec0d07fb508268ea7f9ad395: Status 404 returned error can't find the container with id fb02442ecba6327d62a2ea40c79b307462672455ec0d07fb508268ea7f9ad395 Jun 02 02:45:26.929492 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.929361 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a9d063_a2aa_4ced_b911_f081f70fd46c.slice/crio-4048809c887aec91604c392c824dc42c3bdbef637754703c01df8fbcf58f1cf4 WatchSource:0}: Error finding container 4048809c887aec91604c392c824dc42c3bdbef637754703c01df8fbcf58f1cf4: Status 404 returned error can't find the container with id 4048809c887aec91604c392c824dc42c3bdbef637754703c01df8fbcf58f1cf4 Jun 02 02:45:26.930652 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.930541 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb4fd09_dd0c_4d09_8d05_ff0c775360d9.slice/crio-3bae3742ece4add5b456b25f87c1575c8156ecfd858618af6ed93599fcfd850d WatchSource:0}: Error finding container 3bae3742ece4add5b456b25f87c1575c8156ecfd858618af6ed93599fcfd850d: Status 404 returned error can't find the container with id 3bae3742ece4add5b456b25f87c1575c8156ecfd858618af6ed93599fcfd850d Jun 02 02:45:26.934356 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:45:26.934330 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd00cdc_f46d_41b8_b401_ade2e3585ca9.slice/crio-adddb1ce6a69dd7cdea604e58f80a47b18146912456542172f29db687c8bb5bc WatchSource:0}: Error finding container adddb1ce6a69dd7cdea604e58f80a47b18146912456542172f29db687c8bb5bc: Status 404 returned error can't find the container with id adddb1ce6a69dd7cdea604e58f80a47b18146912456542172f29db687c8bb5bc Jun 02 02:45:26.966573 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:26.966450 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:26.966689 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.966603 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:26.966689 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:26.966666 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:27.96664759 +0000 UTC m=+4.059181891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:27.067327 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.067301 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:27.067470 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:27.067403 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 02:45:27.067470 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:27.067417 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 02:45:27.067470 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:27.067426 2577 projected.go:194] Error preparing data for projected volume kube-api-access-vnvfn for pod openshift-network-diagnostics/network-check-target-qbgkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:27.067470 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:27.067468 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn podName:12a1ec12-6a72-4e51-9345-4ac5406ec62f nodeName:}" failed. No retries permitted until 2026-06-02 02:45:28.067456453 +0000 UTC m=+4.159990750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvfn" (UniqueName: "kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn") pod "network-check-target-qbgkr" (UID: "12a1ec12-6a72-4e51-9345-4ac5406ec62f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:27.393409 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.393342 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 02:40:25 +0000 UTC" deadline="2027-10-29 11:28:46.192011205 +0000 UTC" Jun 02 02:45:27.393409 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.393380 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12344h43m18.798635193s" Jun 02 02:45:27.440671 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.440589 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:27.440818 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:27.440712 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:27.453212 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.453161 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"adddb1ce6a69dd7cdea604e58f80a47b18146912456542172f29db687c8bb5bc"} Jun 02 02:45:27.460609 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.459826 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-226xq" event={"ID":"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9","Type":"ContainerStarted","Data":"3bae3742ece4add5b456b25f87c1575c8156ecfd858618af6ed93599fcfd850d"} Jun 02 02:45:27.464538 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.464470 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" event={"ID":"a8a9d063-a2aa-4ced-b911-f081f70fd46c","Type":"ContainerStarted","Data":"4048809c887aec91604c392c824dc42c3bdbef637754703c01df8fbcf58f1cf4"} Jun 02 02:45:27.467607 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.467549 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s274b" event={"ID":"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb","Type":"ContainerStarted","Data":"fb02442ecba6327d62a2ea40c79b307462672455ec0d07fb508268ea7f9ad395"} Jun 02 02:45:27.470175 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.470113 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8cd6w" event={"ID":"c7ee1cf9-748d-4d8b-b891-73d03814ebcd","Type":"ContainerStarted","Data":"4e73e3e0518645f97f29e432caeb9e82ac3e3bd3552b449f1bb17c34a28895a5"} Jun 02 02:45:27.477972 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.477179 2577 generic.go:358] "Generic (PLEG): container finished" podID="56e2c86f3b29c058e3b6fb1c92fc6cd0" containerID="fb210b20abfaf708a672d6984c8229ef4969a43fd6ce7790c052623226c9fadc" exitCode=0 Jun 02 02:45:27.477972 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.477739 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" event={"ID":"56e2c86f3b29c058e3b6fb1c92fc6cd0","Type":"ContainerDied","Data":"fb210b20abfaf708a672d6984c8229ef4969a43fd6ce7790c052623226c9fadc"} Jun 02 02:45:27.485777 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.484922 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" event={"ID":"f28e4ed091d830f86982f1afbe58a639","Type":"ContainerStarted","Data":"382f77dc387c3937f2229f13300d69e7a7a5ebac78d11699b2fea2440087489b"} Jun 02 02:45:27.489883 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.489846 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pt6th" event={"ID":"abe048da-2772-46b7-a0a5-7584ae6973a8","Type":"ContainerStarted","Data":"bbc3515ea91e16c955d4d887e9950a4bdddbb77b290cf5ece868ceda6ddfebab"} Jun 02 02:45:27.502338 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.502299 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-87.ec2.internal" podStartSLOduration=2.502287017 podStartE2EDuration="2.502287017s" podCreationTimestamp="2026-06-02 02:45:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:45:27.50167142 +0000 UTC m=+3.594205742" watchObservedRunningTime="2026-06-02 02:45:27.502287017 +0000 UTC m=+3.594821335" Jun 02 02:45:27.512776 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.512751 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fbr8w" event={"ID":"bc5ff513-a73b-44c9-bc56-e36cd25812cf","Type":"ContainerStarted","Data":"a21cf9d854143609abcf048886fb855d7dedaffa42f093e8676c3bc455b5e6ab"} Jun 02 02:45:27.517749 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.517724 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerStarted","Data":"a5faa8f13d8840b8bad5a0ed1c2d814e8d36bf095d0e5f60e66a56d3ac838feb"} Jun 02 02:45:27.537380 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.537343 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9hqx" event={"ID":"50004b00-43fb-4069-96df-172af5344eb8","Type":"ContainerStarted","Data":"3d55fa46484b83284f05d9976350a96d2ce47c57e83dbbf26079698f2c0b3a14"} Jun 02 02:45:27.976320 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:27.976284 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:27.976513 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:27.976462 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:27.976582 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:27.976527 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:29.976508283 +0000 UTC m=+6.069042579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:28.077061 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:28.077025 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:28.077277 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:28.077262 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 02:45:28.077352 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:28.077283 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 02:45:28.077352 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:28.077297 2577 projected.go:194] Error preparing data for projected volume kube-api-access-vnvfn for pod openshift-network-diagnostics/network-check-target-qbgkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:28.077457 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:28.077356 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn podName:12a1ec12-6a72-4e51-9345-4ac5406ec62f nodeName:}" failed. No retries permitted until 2026-06-02 02:45:30.077337163 +0000 UTC m=+6.169871460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvfn" (UniqueName: "kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn") pod "network-check-target-qbgkr" (UID: "12a1ec12-6a72-4e51-9345-4ac5406ec62f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:28.441552 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:28.441468 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:28.442001 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:28.441604 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:28.561280 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:28.561245 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" event={"ID":"56e2c86f3b29c058e3b6fb1c92fc6cd0","Type":"ContainerStarted","Data":"a9cde80bd00b583ece5cfded8285cd4bf36fdd9a638ba85be40a8f5e903ddf65"} Jun 02 02:45:29.441229 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:29.440752 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:29.441229 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:29.440889 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:29.994356 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:29.994321 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:29.994818 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:29.994493 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:29.994818 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:29.994571 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:33.994551007 +0000 UTC m=+10.087085313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:30.094946 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:30.094889 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:30.095118 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:30.095069 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 02:45:30.095118 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:30.095116 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 02:45:30.095226 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:30.095129 2577 projected.go:194] Error preparing data for projected volume kube-api-access-vnvfn for pod openshift-network-diagnostics/network-check-target-qbgkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:30.095226 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:30.095186 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn podName:12a1ec12-6a72-4e51-9345-4ac5406ec62f nodeName:}" failed. No retries permitted until 2026-06-02 02:45:34.095167863 +0000 UTC m=+10.187702166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvfn" (UniqueName: "kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn") pod "network-check-target-qbgkr" (UID: "12a1ec12-6a72-4e51-9345-4ac5406ec62f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:30.443267 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:30.443189 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:30.443416 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:30.443328 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:31.441150 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:31.441113 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:31.441631 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:31.441256 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:32.441414 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:32.441379 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:32.441841 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:32.441520 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:33.440963 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:33.440929 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:33.441133 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:33.441059 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:34.028953 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:34.028910 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:34.029422 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:34.029066 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:34.029422 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:34.029126 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:42.029106976 +0000 UTC m=+18.121641281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:34.129823 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:34.129783 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:34.130018 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:34.129977 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 02:45:34.130018 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:34.129996 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 02:45:34.130018 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:34.130008 2577 projected.go:194] Error preparing data for projected volume kube-api-access-vnvfn for pod openshift-network-diagnostics/network-check-target-qbgkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:34.130190 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:34.130065 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn podName:12a1ec12-6a72-4e51-9345-4ac5406ec62f nodeName:}" failed. No retries permitted until 2026-06-02 02:45:42.130045865 +0000 UTC m=+18.222580163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvfn" (UniqueName: "kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn") pod "network-check-target-qbgkr" (UID: "12a1ec12-6a72-4e51-9345-4ac5406ec62f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:34.441258 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:34.441044 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:34.441258 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:34.441160 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:35.441484 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:35.441019 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:35.441484 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:35.441144 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:36.440399 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:36.440366 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:36.440558 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:36.440506 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:37.440487 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:37.440456 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:37.440877 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:37.440560 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:38.441281 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:38.441245 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:38.441709 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:38.441405 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:39.440705 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:39.440672 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:39.440885 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:39.440803 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:40.441025 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:40.440936 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:40.441485 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:40.441079 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:41.440931 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:41.440898 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:41.441182 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:41.441025 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:42.091958 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:42.091917 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:42.092128 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:42.092097 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:42.092193 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:42.092173 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:58.092152142 +0000 UTC m=+34.184686459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:42.192977 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:42.192940 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:42.193139 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:42.193111 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 02:45:42.193139 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:42.193130 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 02:45:42.193139 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:42.193141 2577 projected.go:194] Error preparing data for projected volume kube-api-access-vnvfn for pod openshift-network-diagnostics/network-check-target-qbgkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:42.193282 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:42.193192 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn podName:12a1ec12-6a72-4e51-9345-4ac5406ec62f nodeName:}" failed. No retries permitted until 2026-06-02 02:45:58.193179185 +0000 UTC m=+34.285713485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvfn" (UniqueName: "kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn") pod "network-check-target-qbgkr" (UID: "12a1ec12-6a72-4e51-9345-4ac5406ec62f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:42.440478 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:42.440396 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:42.440634 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:42.440526 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:43.440991 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:43.440953 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:43.441404 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:43.441087 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:44.441095 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:44.441066 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:44.441476 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:44.441151 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:45.441544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.441191 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:45.442025 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:45.441652 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:45.590561 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.590532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:45:45.590960 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.590925 2577 generic.go:358] "Generic (PLEG): container finished" podID="2fd00cdc-f46d-41b8-b401-ade2e3585ca9" containerID="65e6e06b85b23d517ffc266970af878ef1b919e7282ee60f0603dab51c20edc2" exitCode=1 Jun 02 02:45:45.591076 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.591004 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"40bf1146bb34b5e0c7e10ded91883929399810a5f935606029fa346ef7fc03ed"} Jun 02 02:45:45.591076 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.591043 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"a5c22ba06f7375c3d9367f7be31cf8bb436990544f1ab1218e04f5afe47b758d"} Jun 02 02:45:45.591076 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.591056 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"d7dad643b70e3cc12c5f7e45c20a8c473583b465eaeceeadc45b879ab0052d6a"} Jun 02 02:45:45.591242 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.591069 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerDied","Data":"65e6e06b85b23d517ffc266970af878ef1b919e7282ee60f0603dab51c20edc2"} Jun 02 02:45:45.591242 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.591095 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"e27224cad7ac04bbf06d160350575b376e757f0dc24fc174236bff476660c39e"} Jun 02 02:45:45.592486 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.592458 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-226xq" event={"ID":"ccb4fd09-dd0c-4d09-8d05-ff0c775360d9","Type":"ContainerStarted","Data":"5c870e04f8e75542b0b86c251a958160b301ef8e534469f159e021e54a58f8a6"} Jun 02 02:45:45.593898 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.593873 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" event={"ID":"a8a9d063-a2aa-4ced-b911-f081f70fd46c","Type":"ContainerStarted","Data":"d4f017f507428b83893f18ac8f37a87f1599e86469bb2b4f21477952a5852886"} Jun 02 02:45:45.594962 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.594943 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s274b" event={"ID":"bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb","Type":"ContainerStarted","Data":"e2b0f871a2466e0814c353dabcb5823e1606403d9c77a8d4f204fc082bc4977d"} Jun 02 02:45:45.596327 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.596297 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pt6th" event={"ID":"abe048da-2772-46b7-a0a5-7584ae6973a8","Type":"ContainerStarted","Data":"d11f36467513bb2b8ac09bcff3746d3cb5765f1fe44a447757d3ef60cd086f38"} Jun 02 02:45:45.597522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.597497 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fbr8w" event={"ID":"bc5ff513-a73b-44c9-bc56-e36cd25812cf","Type":"ContainerStarted","Data":"f1542e0dbd87098dda4d76ec9a6d1f640b3e531eb4f6c03f7ae2fd82434ceab1"} Jun 02 02:45:45.598702 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.598679 2577 generic.go:358] "Generic (PLEG): container finished" podID="fbc63c29-97cc-47e3-bf26-130f852a9b5e" containerID="999cd8b373a353b487d218dfb1393c40882a998552850b1e32530c6eb8922a4b" exitCode=0 Jun 02 02:45:45.598787 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.598735 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerDied","Data":"999cd8b373a353b487d218dfb1393c40882a998552850b1e32530c6eb8922a4b"} Jun 02 02:45:45.600064 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.600043 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9hqx" event={"ID":"50004b00-43fb-4069-96df-172af5344eb8","Type":"ContainerStarted","Data":"fbc8dac9a87d657a494ef2a2d3808c5c26d767696ea97aff586fa8418c7b3d9b"} Jun 02 02:45:45.607130 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.607092 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-87.ec2.internal" podStartSLOduration=20.607078889 podStartE2EDuration="20.607078889s" podCreationTimestamp="2026-06-02 02:45:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:45:28.589335329 +0000 UTC m=+4.681869648" watchObservedRunningTime="2026-06-02 02:45:45.607078889 +0000 UTC m=+21.699613208" Jun 02 02:45:45.623996 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.623965 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-k9hqx" podStartSLOduration=3.922341929 podStartE2EDuration="21.623954586s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.923209039 +0000 UTC m=+3.015743335" lastFinishedPulling="2026-06-02 02:45:44.624821682 +0000 UTC m=+20.717355992" observedRunningTime="2026-06-02 02:45:45.62393578 +0000 UTC m=+21.716470097" watchObservedRunningTime="2026-06-02 02:45:45.623954586 +0000 UTC m=+21.716488895" Jun 02 02:45:45.624277 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.624256 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-226xq" podStartSLOduration=8.434658859 podStartE2EDuration="21.624251422s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.933906613 +0000 UTC m=+3.026440917" lastFinishedPulling="2026-06-02 02:45:40.123499178 +0000 UTC m=+16.216033480" observedRunningTime="2026-06-02 02:45:45.606945333 +0000 UTC m=+21.699479670" watchObservedRunningTime="2026-06-02 02:45:45.624251422 +0000 UTC m=+21.716785740" Jun 02 02:45:45.650245 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.650211 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fbr8w" podStartSLOduration=4.066033585 podStartE2EDuration="21.650201703s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.92748894 +0000 UTC m=+3.020023243" lastFinishedPulling="2026-06-02 02:45:44.511657063 +0000 UTC m=+20.604191361" observedRunningTime="2026-06-02 02:45:45.650091834 +0000 UTC m=+21.742626153" watchObservedRunningTime="2026-06-02 02:45:45.650201703 +0000 UTC m=+21.742736020" Jun 02 02:45:45.650523 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.650502 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s274b" podStartSLOduration=3.999062639 podStartE2EDuration="21.650498027s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.931382811 +0000 UTC m=+3.023917108" lastFinishedPulling="2026-06-02 02:45:44.582818187 +0000 UTC m=+20.675352496" observedRunningTime="2026-06-02 02:45:45.636522711 +0000 UTC m=+21.729057030" watchObservedRunningTime="2026-06-02 02:45:45.650498027 +0000 UTC m=+21.743032347" Jun 02 02:45:45.675613 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.675566 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pt6th" podStartSLOduration=4.018824811 podStartE2EDuration="21.675551677s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.928808021 +0000 UTC m=+3.021342316" lastFinishedPulling="2026-06-02 02:45:44.585534877 +0000 UTC m=+20.678069182" observedRunningTime="2026-06-02 02:45:45.675354338 +0000 UTC m=+21.767888656" watchObservedRunningTime="2026-06-02 02:45:45.675551677 +0000 UTC m=+21.768085996" Jun 02 02:45:45.808358 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:45.808337 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 02:45:46.401300 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.401138 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T02:45:45.808358017Z","UUID":"17ec3855-e99a-40a3-a9c1-ac3266957c38","Handler":null,"Name":"","Endpoint":""} Jun 02 02:45:46.403004 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.402964 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 02:45:46.403004 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.402992 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 02:45:46.440767 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.440719 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:46.440956 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:46.440856 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:46.604642 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.604610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:45:46.605071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.605010 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"269f09e17160abc2be0d4c0910ac1be54ed3be2548499864da004911656738b6"} Jun 02 02:45:46.606693 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.606665 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" event={"ID":"a8a9d063-a2aa-4ced-b911-f081f70fd46c","Type":"ContainerStarted","Data":"8d512ef245881f0cabf6fe74d1c3b6ccf0a145131caf262511eb37802217ba72"} Jun 02 02:45:46.608014 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:46.607988 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8cd6w" event={"ID":"c7ee1cf9-748d-4d8b-b891-73d03814ebcd","Type":"ContainerStarted","Data":"96644296e60d4bcfdf804e9782604973c50901cabbfa39d4a07e73fb7d03a0a0"} Jun 02 02:45:47.440434 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:47.440406 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:47.440588 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:47.440526 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:47.611323 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:47.611270 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" event={"ID":"a8a9d063-a2aa-4ced-b911-f081f70fd46c","Type":"ContainerStarted","Data":"9b45cdcc241b5cf5996ce95b5edf0729e64b32599017339fd6bd884675ea005e"} Jun 02 02:45:47.634475 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:47.634431 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8cd6w" podStartSLOduration=5.98107624 podStartE2EDuration="23.634416662s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.93140293 +0000 UTC m=+3.023937232" lastFinishedPulling="2026-06-02 02:45:44.584743355 +0000 UTC m=+20.677277654" observedRunningTime="2026-06-02 02:45:46.623230367 +0000 UTC m=+22.715764695" watchObservedRunningTime="2026-06-02 02:45:47.634416662 +0000 UTC m=+23.726950979" Jun 02 02:45:47.634955 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:47.634925 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hsmv" podStartSLOduration=3.693737303 podStartE2EDuration="23.634915198s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.932422951 +0000 UTC m=+3.024957251" lastFinishedPulling="2026-06-02 02:45:46.873600843 +0000 UTC m=+22.966135146" observedRunningTime="2026-06-02 02:45:47.634313425 +0000 UTC m=+23.726847743" watchObservedRunningTime="2026-06-02 02:45:47.634915198 +0000 UTC m=+23.727449515" Jun 02 02:45:48.031270 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:48.030971 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:48.031688 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:48.031667 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:48.440584 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:48.440514 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:48.440720 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:48.440626 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:48.616488 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:48.616462 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:45:48.616974 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:48.616818 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"94305bdddcbfa85429419e1bee8ec228f28990cf9fdd677be5eee084fdc3ba7b"} Jun 02 02:45:48.617276 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:48.617252 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:48.617720 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:48.617701 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-226xq" Jun 02 02:45:49.440805 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:49.440778 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:49.440975 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:49.440898 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:49.620758 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:49.620717 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerStarted","Data":"6d5eee7113671027d64c71e4d3ec8d3029634c835268a4485ed361b5801344b9"} Jun 02 02:45:50.440538 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.440370 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:50.440692 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:50.440623 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:50.625207 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.625177 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:45:50.625845 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.625550 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"742414a939c3014501603490d27d65f8bdffcfb7fed77d5ccc84bc2baa29c917"} Jun 02 02:45:50.625937 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.625911 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:50.626086 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.626070 2577 scope.go:117] "RemoveContainer" containerID="65e6e06b85b23d517ffc266970af878ef1b919e7282ee60f0603dab51c20edc2" Jun 02 02:45:50.629659 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.627911 2577 generic.go:358] "Generic (PLEG): container finished" podID="fbc63c29-97cc-47e3-bf26-130f852a9b5e" containerID="6d5eee7113671027d64c71e4d3ec8d3029634c835268a4485ed361b5801344b9" exitCode=0 Jun 02 02:45:50.629659 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.628013 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerDied","Data":"6d5eee7113671027d64c71e4d3ec8d3029634c835268a4485ed361b5801344b9"} Jun 02 02:45:50.642959 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:50.642936 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:51.440473 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.440442 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:51.440603 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:51.440546 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:51.632422 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.632401 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:45:51.632776 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.632755 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" event={"ID":"2fd00cdc-f46d-41b8-b401-ade2e3585ca9","Type":"ContainerStarted","Data":"731f652d02931e7027f5e093133b85ac21468af369a06208d673909b655a6e04"} Jun 02 02:45:51.633097 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.633073 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:51.633097 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.633118 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:51.634770 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.634749 2577 generic.go:358] "Generic (PLEG): container finished" podID="fbc63c29-97cc-47e3-bf26-130f852a9b5e" containerID="08d5664408f5bd663ab1b01d2a60077a28926124d03ed5bdaf4f1d2ad1c2d5f2" exitCode=0 Jun 02 02:45:51.634846 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.634779 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerDied","Data":"08d5664408f5bd663ab1b01d2a60077a28926124d03ed5bdaf4f1d2ad1c2d5f2"} Jun 02 02:45:51.649156 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.649134 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:45:51.660270 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.660232 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" podStartSLOduration=9.722266757 podStartE2EDuration="27.660219718s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.935982524 +0000 UTC m=+3.028516820" lastFinishedPulling="2026-06-02 02:45:44.873935477 +0000 UTC m=+20.966469781" observedRunningTime="2026-06-02 02:45:51.658728843 +0000 UTC m=+27.751263160" watchObservedRunningTime="2026-06-02 02:45:51.660219718 +0000 UTC m=+27.752754039" Jun 02 02:45:51.817924 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.817894 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-69mdd"] Jun 02 02:45:51.818244 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.818034 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:51.818244 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:51.818155 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:51.828399 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.828372 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qbgkr"] Jun 02 02:45:51.828501 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:51.828447 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:51.828540 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:51.828519 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:52.638906 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:52.638641 2577 generic.go:358] "Generic (PLEG): container finished" podID="fbc63c29-97cc-47e3-bf26-130f852a9b5e" containerID="21634c3e75e77bc6bf15d567e36638ffac93aa9d65c29d0dcff8cdab97fe3865" exitCode=0 Jun 02 02:45:52.639268 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:52.638723 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerDied","Data":"21634c3e75e77bc6bf15d567e36638ffac93aa9d65c29d0dcff8cdab97fe3865"} Jun 02 02:45:53.441019 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:53.440984 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:53.441206 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:53.441111 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:53.441206 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:53.441161 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:53.441332 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:53.441292 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:55.441117 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:55.441082 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:55.441742 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:55.441207 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:55.441742 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:55.441269 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:55.441742 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:55.441387 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:57.440945 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.440903 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:57.441546 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.440903 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:57.441546 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:57.441056 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:45:57.441546 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:57.441153 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qbgkr" podUID="12a1ec12-6a72-4e51-9345-4ac5406ec62f" Jun 02 02:45:57.761003 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.760969 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-87.ec2.internal" event="NodeReady" Jun 02 02:45:57.761186 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.761119 2577 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 02:45:57.807842 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.807807 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2l84v"] Jun 02 02:45:57.869010 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.868970 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nd6nh"] Jun 02 02:45:57.869184 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.869156 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:57.872119 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.871888 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 02:45:57.872257 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.872184 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5469w\"" Jun 02 02:45:57.872257 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.872199 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 02:45:57.882062 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.882041 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2l84v"] Jun 02 02:45:57.882170 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.882067 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nd6nh"] Jun 02 02:45:57.882170 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.882165 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:57.884694 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.884673 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 02:45:57.884804 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.884715 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kcfjp\"" Jun 02 02:45:57.885234 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.884987 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 02:45:57.885234 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:57.885007 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 02:45:58.013503 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.013419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7tcz\" (UniqueName: \"kubernetes.io/projected/43efa475-b2df-4f80-a9ab-3621f4e6a393-kube-api-access-k7tcz\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.013503 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.013485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.013681 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.013512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43efa475-b2df-4f80-a9ab-3621f4e6a393-tmp-dir\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.013681 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.013527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43efa475-b2df-4f80-a9ab-3621f4e6a393-config-volume\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.013681 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.013545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zjx8\" (UniqueName: \"kubernetes.io/projected/62adc8e6-67d7-4417-b182-8178137cce23-kube-api-access-7zjx8\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:58.013681 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.013593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:58.114822 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.114786 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:58.115009 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.114829 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7tcz\" (UniqueName: \"kubernetes.io/projected/43efa475-b2df-4f80-a9ab-3621f4e6a393-kube-api-access-k7tcz\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.115009 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.114879 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:58.115009 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.114922 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.115009 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.114954 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:45:58.115193 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.115024 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:58.115193 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.114960 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43efa475-b2df-4f80-a9ab-3621f4e6a393-tmp-dir\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.115193 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.115028 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:58.615007631 +0000 UTC m=+34.707541951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:45:58.115193 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.115061 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:45:58.115193 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.115111 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:30.115080592 +0000 UTC m=+66.207614894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 02:45:58.115193 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.115145 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:58.615135031 +0000 UTC m=+34.707669328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:45:58.115475 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.115188 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43efa475-b2df-4f80-a9ab-3621f4e6a393-config-volume\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.115475 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.115221 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zjx8\" (UniqueName: \"kubernetes.io/projected/62adc8e6-67d7-4417-b182-8178137cce23-kube-api-access-7zjx8\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:58.115475 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.115267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43efa475-b2df-4f80-a9ab-3621f4e6a393-tmp-dir\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.115722 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.115700 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43efa475-b2df-4f80-a9ab-3621f4e6a393-config-volume\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.125269 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.125246 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7tcz\" (UniqueName: \"kubernetes.io/projected/43efa475-b2df-4f80-a9ab-3621f4e6a393-kube-api-access-k7tcz\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.151292 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.151258 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zjx8\" (UniqueName: \"kubernetes.io/projected/62adc8e6-67d7-4417-b182-8178137cce23-kube-api-access-7zjx8\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:58.215703 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.215668 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:58.215894 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.215855 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 02:45:58.215964 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.215900 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 02:45:58.215964 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.215918 2577 projected.go:194] Error preparing data for projected volume kube-api-access-vnvfn for pod openshift-network-diagnostics/network-check-target-qbgkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:58.216065 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.215986 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn podName:12a1ec12-6a72-4e51-9345-4ac5406ec62f nodeName:}" failed. No retries permitted until 2026-06-02 02:46:30.215966841 +0000 UTC m=+66.308501143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnvfn" (UniqueName: "kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn") pod "network-check-target-qbgkr" (UID: "12a1ec12-6a72-4e51-9345-4ac5406ec62f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 02:45:58.619188 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.619157 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:58.619564 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.619215 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:58.619564 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.619303 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:45:58.619564 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.619306 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:45:58.619564 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.619353 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:59.619339627 +0000 UTC m=+35.711873922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:45:58.619564 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:58.619367 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:45:59.619361039 +0000 UTC m=+35.711895335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:45:58.651669 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.651644 2577 generic.go:358] "Generic (PLEG): container finished" podID="fbc63c29-97cc-47e3-bf26-130f852a9b5e" containerID="eb219a07160582f5d7e39765c7ff11e752e5548ce82c38c5bb9b7ef2fa4105b3" exitCode=0 Jun 02 02:45:58.651796 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:58.651701 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerDied","Data":"eb219a07160582f5d7e39765c7ff11e752e5548ce82c38c5bb9b7ef2fa4105b3"} Jun 02 02:45:59.441030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.440948 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:45:59.441179 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.440948 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:45:59.444812 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.444791 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 02:45:59.444812 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.444790 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 02:45:59.444987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.444826 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 02:45:59.444987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.444799 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldjq9\"" Jun 02 02:45:59.444987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.444791 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bgk2p\"" Jun 02 02:45:59.627732 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.627701 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:45:59.628118 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.627767 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:45:59.628118 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:59.627852 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:45:59.628118 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:59.627882 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:45:59.628118 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:59.627930 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:01.627915202 +0000 UTC m=+37.720449499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:45:59.628118 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:45:59.627947 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:01.627938513 +0000 UTC m=+37.720472809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:45:59.656666 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.656639 2577 generic.go:358] "Generic (PLEG): container finished" podID="fbc63c29-97cc-47e3-bf26-130f852a9b5e" containerID="77da61659c2430260aff915bdd8f4ee162e17a730a20f2675621e1ae24f0b8d4" exitCode=0 Jun 02 02:45:59.656804 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:45:59.656677 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerDied","Data":"77da61659c2430260aff915bdd8f4ee162e17a730a20f2675621e1ae24f0b8d4"} Jun 02 02:46:00.661452 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:00.661420 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" event={"ID":"fbc63c29-97cc-47e3-bf26-130f852a9b5e","Type":"ContainerStarted","Data":"dc65c1be6b35410d41f5329da3cc613c2a220982537e6edf297409a889d18511"} Jun 02 02:46:00.685206 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:00.685160 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vt4vr" podStartSLOduration=5.288361581 podStartE2EDuration="36.685145748s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:45:26.925149836 +0000 UTC m=+3.017684136" lastFinishedPulling="2026-06-02 02:45:58.321934007 +0000 UTC m=+34.414468303" observedRunningTime="2026-06-02 02:46:00.684006535 +0000 UTC m=+36.776540857" watchObservedRunningTime="2026-06-02 02:46:00.685145748 +0000 UTC m=+36.777680066" Jun 02 02:46:01.645734 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:01.645651 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:46:01.645880 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:01.645748 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:46:01.645880 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:01.645790 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:46:01.645969 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:01.645878 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:05.645843433 +0000 UTC m=+41.738377730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:46:01.645969 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:01.645907 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:46:01.646067 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:01.645971 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:05.645954008 +0000 UTC m=+41.738488304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:46:05.672525 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:05.672493 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:46:05.672977 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:05.672560 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:46:05.672977 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:05.672648 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:46:05.672977 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:05.672675 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:46:05.672977 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:05.672710 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:13.672691798 +0000 UTC m=+49.765226094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:46:05.672977 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:05.672725 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:13.672718729 +0000 UTC m=+49.765253025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:46:13.726099 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:13.726068 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:46:13.726639 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:13.726126 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:46:13.726639 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:13.726217 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:46:13.726639 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:13.726218 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:46:13.726639 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:13.726267 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:29.726253716 +0000 UTC m=+65.818788012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:46:13.726639 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:13.726280 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:46:29.72627453 +0000 UTC m=+65.818808826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:46:23.650309 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:23.650278 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pw6lq" Jun 02 02:46:29.735012 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:29.734982 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:46:29.735402 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:29.735037 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:46:29.735402 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:29.735134 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:46:29.735402 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:29.735135 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:46:29.735402 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:29.735183 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:01.735169989 +0000 UTC m=+97.827704285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:46:29.735402 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:29.735198 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:01.735190381 +0000 UTC m=+97.827724676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:46:30.137325 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.137239 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:46:30.139869 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.139844 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 02:46:30.147989 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:30.147972 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 02:46:30.148051 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:46:30.148040 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:34.148022185 +0000 UTC m=+130.240556481 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : secret "metrics-daemon-secret" not found Jun 02 02:46:30.238304 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.238273 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:46:30.241212 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.241196 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 02:46:30.251584 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.251565 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 02:46:30.262865 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.262846 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvfn\" (UniqueName: \"kubernetes.io/projected/12a1ec12-6a72-4e51-9345-4ac5406ec62f-kube-api-access-vnvfn\") pod \"network-check-target-qbgkr\" (UID: \"12a1ec12-6a72-4e51-9345-4ac5406ec62f\") " pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:46:30.353984 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.353935 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldjq9\"" Jun 02 02:46:30.361998 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.361983 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:46:30.522042 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.522004 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qbgkr"] Jun 02 02:46:30.526057 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:46:30.526031 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a1ec12_6a72_4e51_9345_4ac5406ec62f.slice/crio-c141ba63ba92a3aad7484d5e81fd5fe82c0925ea2ec635a7996e48d7e8578dd9 WatchSource:0}: Error finding container c141ba63ba92a3aad7484d5e81fd5fe82c0925ea2ec635a7996e48d7e8578dd9: Status 404 returned error can't find the container with id c141ba63ba92a3aad7484d5e81fd5fe82c0925ea2ec635a7996e48d7e8578dd9 Jun 02 02:46:30.713502 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:30.713469 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qbgkr" event={"ID":"12a1ec12-6a72-4e51-9345-4ac5406ec62f","Type":"ContainerStarted","Data":"c141ba63ba92a3aad7484d5e81fd5fe82c0925ea2ec635a7996e48d7e8578dd9"} Jun 02 02:46:33.719912 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:33.719879 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qbgkr" event={"ID":"12a1ec12-6a72-4e51-9345-4ac5406ec62f","Type":"ContainerStarted","Data":"ba39d0450b72cf7bdb647ee11676579494dc073a75d9d81b214f4de48d064d34"} Jun 02 02:46:33.720335 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:33.719997 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:46:33.736551 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:46:33.736511 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qbgkr" podStartSLOduration=67.21415322 podStartE2EDuration="1m9.736498921s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:46:30.528275706 +0000 UTC m=+66.620810023" lastFinishedPulling="2026-06-02 02:46:33.050621428 +0000 UTC m=+69.143155724" observedRunningTime="2026-06-02 02:46:33.73561422 +0000 UTC m=+69.828148546" watchObservedRunningTime="2026-06-02 02:46:33.736498921 +0000 UTC m=+69.829033238" Jun 02 02:47:01.753894 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:01.753827 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:47:01.754305 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:01.753940 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:47:01.754305 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:01.753986 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 02:47:01.754305 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:01.754019 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 02:47:01.754305 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:01.754066 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls podName:43efa475-b2df-4f80-a9ab-3621f4e6a393 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:05.754049551 +0000 UTC m=+161.846583847 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls") pod "dns-default-2l84v" (UID: "43efa475-b2df-4f80-a9ab-3621f4e6a393") : secret "dns-default-metrics-tls" not found Jun 02 02:47:01.754305 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:01.754082 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert podName:62adc8e6-67d7-4417-b182-8178137cce23 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:05.754075901 +0000 UTC m=+161.846610197 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert") pod "ingress-canary-nd6nh" (UID: "62adc8e6-67d7-4417-b182-8178137cce23") : secret "canary-serving-cert" not found Jun 02 02:47:04.724711 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:04.724676 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qbgkr" Jun 02 02:47:34.164344 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:34.164287 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:47:34.164828 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:34.164449 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 02:47:34.164828 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:34.164533 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs podName:51ff4c93-dadf-4a56-9e65-645b1123c885 nodeName:}" failed. No retries permitted until 2026-06-02 02:49:36.16451403 +0000 UTC m=+252.257048333 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs") pod "network-metrics-daemon-69mdd" (UID: "51ff4c93-dadf-4a56-9e65-645b1123c885") : secret "metrics-daemon-secret" not found Jun 02 02:47:45.498157 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.498123 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g"] Jun 02 02:47:45.500000 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.499984 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.502561 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.502540 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 02:47:45.503813 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.503794 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 02:47:45.504972 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.504938 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c8cjq\"" Jun 02 02:47:45.505145 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.505108 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 02:47:45.505354 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.505335 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 02:47:45.513268 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.513245 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g"] Jun 02 02:47:45.641308 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.641271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.641492 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.641314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.641492 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.641413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gggnp\" (UniqueName: \"kubernetes.io/projected/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-kube-api-access-gggnp\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.741751 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.741716 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gggnp\" (UniqueName: \"kubernetes.io/projected/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-kube-api-access-gggnp\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.741837 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.741786 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.741837 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.741810 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.741976 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:45.741955 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:45.742067 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:45.742056 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls podName:83730f9b-72e3-45f3-9cfd-64f8faa37ea6 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:46.242039294 +0000 UTC m=+142.334573591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mrf8g" (UID: "83730f9b-72e3-45f3-9cfd-64f8faa37ea6") : secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:45.742440 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.742422 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.750510 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.750468 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gggnp\" (UniqueName: \"kubernetes.io/projected/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-kube-api-access-gggnp\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:45.783593 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.783575 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62"] Jun 02 02:47:45.785448 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.785435 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" Jun 02 02:47:45.786671 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.786651 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26"] Jun 02 02:47:45.787755 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.787732 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 02:47:45.787851 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.787740 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:47:45.787851 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.787806 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c27dn\"" Jun 02 02:47:45.788242 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.788228 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:45.790390 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.790371 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 02:47:45.790634 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.790608 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 02:47:45.790733 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.790674 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:47:45.790733 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.790723 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tzcgr\"" Jun 02 02:47:45.795597 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.795578 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62"] Jun 02 02:47:45.798777 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.798752 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26"] Jun 02 02:47:45.888659 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.888635 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs"] Jun 02 02:47:45.890353 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.890340 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" Jun 02 02:47:45.892809 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.892778 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qtf8c\"" Jun 02 02:47:45.893666 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.893647 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58886f6fcf-jfhqq"] Jun 02 02:47:45.895499 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.895480 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:45.899226 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.899206 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 02:47:45.899226 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.899227 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 02:47:45.899226 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.899233 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 02:47:45.899528 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.899443 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 02:47:45.899528 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.899520 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hql5q\"" Jun 02 02:47:45.899670 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.899629 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 02:47:45.899752 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.899716 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 02:47:45.902748 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.902621 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs"] Jun 02 02:47:45.912420 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.912401 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58886f6fcf-jfhqq"] Jun 02 02:47:45.943987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.943967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:45.944100 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.944019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw4q6\" (UniqueName: \"kubernetes.io/projected/1498f5ee-ac12-48c5-b861-9b2e4c332b06-kube-api-access-tw4q6\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:45.944100 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.944039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwmrf\" (UniqueName: \"kubernetes.io/projected/a2ed165b-9aaa-461e-a4e7-bb77be221b51-kube-api-access-dwmrf\") pod \"volume-data-source-validator-7598fd5bd-w8q62\" (UID: \"a2ed165b-9aaa-461e-a4e7-bb77be221b51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" Jun 02 02:47:45.987297 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.987267 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-h65cd"] Jun 02 02:47:45.989058 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.989045 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:45.991592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.991563 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 02:47:45.991713 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.991566 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:47:45.991713 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.991544 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 02:47:45.991713 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.991662 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rcrf2\"" Jun 02 02:47:45.991945 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:45.991931 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 02:47:46.000332 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.000305 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-h65cd"] Jun 02 02:47:46.045363 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-default-certificate\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.045363 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xlw\" (UniqueName: \"kubernetes.io/projected/90125e5f-aacc-4df5-9652-abdf545a10c5-kube-api-access-w7xlw\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.045508 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.045508 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.045584 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045512 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:46.045621 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045588 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw4q6\" (UniqueName: \"kubernetes.io/projected/1498f5ee-ac12-48c5-b861-9b2e4c332b06-kube-api-access-tw4q6\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:46.045621 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.045600 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 02:47:46.045621 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045614 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwmrf\" (UniqueName: \"kubernetes.io/projected/a2ed165b-9aaa-461e-a4e7-bb77be221b51-kube-api-access-dwmrf\") pod \"volume-data-source-validator-7598fd5bd-w8q62\" (UID: \"a2ed165b-9aaa-461e-a4e7-bb77be221b51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" Jun 02 02:47:46.045754 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88drm\" (UniqueName: \"kubernetes.io/projected/1441de6d-3092-4823-b097-72bacecc474c-kube-api-access-88drm\") pod \"network-check-source-56d84b9f44-n6xxs\" (UID: \"1441de6d-3092-4823-b097-72bacecc474c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" Jun 02 02:47:46.045754 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.045642 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls podName:1498f5ee-ac12-48c5-b861-9b2e4c332b06 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:46.545628529 +0000 UTC m=+142.638162824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-fts26" (UID: "1498f5ee-ac12-48c5-b861-9b2e4c332b06") : secret "samples-operator-tls" not found Jun 02 02:47:46.045754 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.045712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-stats-auth\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.054272 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.054244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw4q6\" (UniqueName: \"kubernetes.io/projected/1498f5ee-ac12-48c5-b861-9b2e4c332b06-kube-api-access-tw4q6\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:46.054363 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.054309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwmrf\" (UniqueName: \"kubernetes.io/projected/a2ed165b-9aaa-461e-a4e7-bb77be221b51-kube-api-access-dwmrf\") pod \"volume-data-source-validator-7598fd5bd-w8q62\" (UID: \"a2ed165b-9aaa-461e-a4e7-bb77be221b51\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" Jun 02 02:47:46.095240 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.095217 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" Jun 02 02:47:46.146648 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abae0371-67a2-4db3-b5aa-2e02157a52ec-serving-cert\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.146776 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146654 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88drm\" (UniqueName: \"kubernetes.io/projected/1441de6d-3092-4823-b097-72bacecc474c-kube-api-access-88drm\") pod \"network-check-source-56d84b9f44-n6xxs\" (UID: \"1441de6d-3092-4823-b097-72bacecc474c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" Jun 02 02:47:46.146776 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146674 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-stats-auth\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.146776 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146717 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-default-certificate\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.146776 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89dgh\" (UniqueName: \"kubernetes.io/projected/abae0371-67a2-4db3-b5aa-2e02157a52ec-kube-api-access-89dgh\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.146776 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146775 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xlw\" (UniqueName: \"kubernetes.io/projected/90125e5f-aacc-4df5-9652-abdf545a10c5-kube-api-access-w7xlw\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.147009 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abae0371-67a2-4db3-b5aa-2e02157a52ec-config\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.147009 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.146968 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.147071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.147008 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.147162 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.147144 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:46.647121972 +0000 UTC m=+142.739656285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : configmap references non-existent config key: service-ca.crt Jun 02 02:47:46.147205 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.147162 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 02:47:46.147240 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.147219 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:46.647202659 +0000 UTC m=+142.739737003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : secret "router-metrics-certs-default" not found Jun 02 02:47:46.149516 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.149487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-stats-auth\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.149635 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.149490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-default-certificate\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.156169 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.155952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xlw\" (UniqueName: \"kubernetes.io/projected/90125e5f-aacc-4df5-9652-abdf545a10c5-kube-api-access-w7xlw\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.156544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.156517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88drm\" (UniqueName: \"kubernetes.io/projected/1441de6d-3092-4823-b097-72bacecc474c-kube-api-access-88drm\") pod \"network-check-source-56d84b9f44-n6xxs\" (UID: \"1441de6d-3092-4823-b097-72bacecc474c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" Jun 02 02:47:46.198445 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.198422 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" Jun 02 02:47:46.212807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.212774 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62"] Jun 02 02:47:46.215523 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:47:46.215496 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ed165b_9aaa_461e_a4e7_bb77be221b51.slice/crio-3cdc64747bd51829589b40fbf13ccaeb97c9cc8c140175c0f4febccf979337ea WatchSource:0}: Error finding container 3cdc64747bd51829589b40fbf13ccaeb97c9cc8c140175c0f4febccf979337ea: Status 404 returned error can't find the container with id 3cdc64747bd51829589b40fbf13ccaeb97c9cc8c140175c0f4febccf979337ea Jun 02 02:47:46.247624 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.247597 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abae0371-67a2-4db3-b5aa-2e02157a52ec-config\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.247719 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.247651 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:46.247775 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.247761 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abae0371-67a2-4db3-b5aa-2e02157a52ec-serving-cert\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.247832 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.247819 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89dgh\" (UniqueName: \"kubernetes.io/projected/abae0371-67a2-4db3-b5aa-2e02157a52ec-kube-api-access-89dgh\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.247883 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.247829 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:46.247948 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.247931 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls podName:83730f9b-72e3-45f3-9cfd-64f8faa37ea6 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:47.247908599 +0000 UTC m=+143.340442898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mrf8g" (UID: "83730f9b-72e3-45f3-9cfd-64f8faa37ea6") : secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:46.248279 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.248256 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abae0371-67a2-4db3-b5aa-2e02157a52ec-config\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.250934 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.250252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abae0371-67a2-4db3-b5aa-2e02157a52ec-serving-cert\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.255838 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.255821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89dgh\" (UniqueName: \"kubernetes.io/projected/abae0371-67a2-4db3-b5aa-2e02157a52ec-kube-api-access-89dgh\") pod \"service-ca-operator-69877444c-h65cd\" (UID: \"abae0371-67a2-4db3-b5aa-2e02157a52ec\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.298472 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.298408 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" Jun 02 02:47:46.314695 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.314559 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs"] Jun 02 02:47:46.317455 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:47:46.317430 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1441de6d_3092_4823_b097_72bacecc474c.slice/crio-a37a1b7d7d0013f1458d1e7b002624186a255d3c7fe83dc087aa7de5b5cb044a WatchSource:0}: Error finding container a37a1b7d7d0013f1458d1e7b002624186a255d3c7fe83dc087aa7de5b5cb044a: Status 404 returned error can't find the container with id a37a1b7d7d0013f1458d1e7b002624186a255d3c7fe83dc087aa7de5b5cb044a Jun 02 02:47:46.417577 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.417549 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-h65cd"] Jun 02 02:47:46.420700 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:47:46.420669 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabae0371_67a2_4db3_b5aa_2e02157a52ec.slice/crio-c627703e9eb535b01a6647d19a09d20f37538983621fbe2d8056d66b7adeea45 WatchSource:0}: Error finding container c627703e9eb535b01a6647d19a09d20f37538983621fbe2d8056d66b7adeea45: Status 404 returned error can't find the container with id c627703e9eb535b01a6647d19a09d20f37538983621fbe2d8056d66b7adeea45 Jun 02 02:47:46.549920 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.549835 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:46.550254 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.549978 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 02:47:46.550254 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.550042 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls podName:1498f5ee-ac12-48c5-b861-9b2e4c332b06 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:47.550027216 +0000 UTC m=+143.642561513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-fts26" (UID: "1498f5ee-ac12-48c5-b861-9b2e4c332b06") : secret "samples-operator-tls" not found Jun 02 02:47:46.650504 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.650473 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.650504 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.650508 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:46.650690 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.650640 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 02:47:46.650690 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.650668 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:47.650645724 +0000 UTC m=+143.743180035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : configmap references non-existent config key: service-ca.crt Jun 02 02:47:46.650781 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:46.650695 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:47.650686736 +0000 UTC m=+143.743221036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : secret "router-metrics-certs-default" not found Jun 02 02:47:46.852324 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.852242 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" event={"ID":"a2ed165b-9aaa-461e-a4e7-bb77be221b51","Type":"ContainerStarted","Data":"3cdc64747bd51829589b40fbf13ccaeb97c9cc8c140175c0f4febccf979337ea"} Jun 02 02:47:46.853383 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.853355 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" event={"ID":"abae0371-67a2-4db3-b5aa-2e02157a52ec","Type":"ContainerStarted","Data":"c627703e9eb535b01a6647d19a09d20f37538983621fbe2d8056d66b7adeea45"} Jun 02 02:47:46.854884 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.854840 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" event={"ID":"1441de6d-3092-4823-b097-72bacecc474c","Type":"ContainerStarted","Data":"50190b063befce1cba60fa25cec6a6221aef787dc9cf08a1af3dac9549bd93f9"} Jun 02 02:47:46.854980 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.854890 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" event={"ID":"1441de6d-3092-4823-b097-72bacecc474c","Type":"ContainerStarted","Data":"a37a1b7d7d0013f1458d1e7b002624186a255d3c7fe83dc087aa7de5b5cb044a"} Jun 02 02:47:46.871949 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:46.871880 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-n6xxs" podStartSLOduration=1.871848491 podStartE2EDuration="1.871848491s" podCreationTimestamp="2026-06-02 02:47:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:47:46.870837737 +0000 UTC m=+142.963372056" watchObservedRunningTime="2026-06-02 02:47:46.871848491 +0000 UTC m=+142.964382812" Jun 02 02:47:47.256100 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:47.256061 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:47.256263 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:47.256224 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:47.256322 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:47.256305 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls podName:83730f9b-72e3-45f3-9cfd-64f8faa37ea6 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:49.256283107 +0000 UTC m=+145.348817412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mrf8g" (UID: "83730f9b-72e3-45f3-9cfd-64f8faa37ea6") : secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:47.558433 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:47.558333 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:47.559017 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:47.558522 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 02:47:47.559017 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:47.558584 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls podName:1498f5ee-ac12-48c5-b861-9b2e4c332b06 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:49.558565184 +0000 UTC m=+145.651099489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-fts26" (UID: "1498f5ee-ac12-48c5-b861-9b2e4c332b06") : secret "samples-operator-tls" not found Jun 02 02:47:47.659825 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:47.659779 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:47.660015 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:47.659835 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:47.660015 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:47.659964 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 02:47:47.660015 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:47.659984 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:49.65996114 +0000 UTC m=+145.752495438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : configmap references non-existent config key: service-ca.crt Jun 02 02:47:47.660173 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:47.660028 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:49.66001153 +0000 UTC m=+145.752545846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : secret "router-metrics-certs-default" not found Jun 02 02:47:47.858310 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:47.858232 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" event={"ID":"a2ed165b-9aaa-461e-a4e7-bb77be221b51","Type":"ContainerStarted","Data":"586e2f29b4232e52fbce8fa2edf96c56b22d95a2df809d51a53dfbd9be0a6008"} Jun 02 02:47:47.873772 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:47.873716 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-w8q62" podStartSLOduration=1.3589093270000001 podStartE2EDuration="2.873698899s" podCreationTimestamp="2026-06-02 02:47:45 +0000 UTC" firstStartedPulling="2026-06-02 02:47:46.217660728 +0000 UTC m=+142.310195024" lastFinishedPulling="2026-06-02 02:47:47.732450284 +0000 UTC m=+143.824984596" observedRunningTime="2026-06-02 02:47:47.873382986 +0000 UTC m=+143.965917303" watchObservedRunningTime="2026-06-02 02:47:47.873698899 +0000 UTC m=+143.966233218" Jun 02 02:47:48.861729 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:48.861694 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" event={"ID":"abae0371-67a2-4db3-b5aa-2e02157a52ec","Type":"ContainerStarted","Data":"e3448c9e865fa3ba481d772846af0dba3037d48e62e42a0e1d3da7bd61fe6514"} Jun 02 02:47:48.878209 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:48.878159 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" podStartSLOduration=1.55079734 podStartE2EDuration="3.878140128s" podCreationTimestamp="2026-06-02 02:47:45 +0000 UTC" firstStartedPulling="2026-06-02 02:47:46.422451551 +0000 UTC m=+142.514985847" lastFinishedPulling="2026-06-02 02:47:48.749794339 +0000 UTC m=+144.842328635" observedRunningTime="2026-06-02 02:47:48.877097272 +0000 UTC m=+144.969631591" watchObservedRunningTime="2026-06-02 02:47:48.878140128 +0000 UTC m=+144.970674452" Jun 02 02:47:49.271225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:49.271193 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:49.271407 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:49.271347 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:49.271471 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:49.271424 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls podName:83730f9b-72e3-45f3-9cfd-64f8faa37ea6 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:53.271404365 +0000 UTC m=+149.363938662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mrf8g" (UID: "83730f9b-72e3-45f3-9cfd-64f8faa37ea6") : secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:49.573667 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:49.573597 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:49.573802 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:49.573764 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 02:47:49.573844 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:49.573829 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls podName:1498f5ee-ac12-48c5-b861-9b2e4c332b06 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:53.57381404 +0000 UTC m=+149.666348335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-fts26" (UID: "1498f5ee-ac12-48c5-b861-9b2e4c332b06") : secret "samples-operator-tls" not found Jun 02 02:47:49.674274 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:49.674242 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:49.674274 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:49.674280 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:49.674497 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:49.674396 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:53.674380084 +0000 UTC m=+149.766914380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : configmap references non-existent config key: service-ca.crt Jun 02 02:47:49.674497 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:49.674406 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 02:47:49.674497 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:49.674441 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:47:53.67443013 +0000 UTC m=+149.766964433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : secret "router-metrics-certs-default" not found Jun 02 02:47:52.405415 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.405378 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-b6gsb"] Jun 02 02:47:52.408488 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.408471 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.411146 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.411128 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 02:47:52.412228 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.412211 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 02:47:52.412307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.412236 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 02:47:52.412307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.412290 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 02:47:52.412393 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.412293 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nv78z\"" Jun 02 02:47:52.417594 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.417574 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-b6gsb"] Jun 02 02:47:52.499391 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.499364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6bf3ecf5-7933-410f-8f76-f881f2cd6917-signing-key\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.499572 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.499462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6bf3ecf5-7933-410f-8f76-f881f2cd6917-signing-cabundle\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.499572 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.499526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkc86\" (UniqueName: \"kubernetes.io/projected/6bf3ecf5-7933-410f-8f76-f881f2cd6917-kube-api-access-vkc86\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.566085 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.566063 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fbr8w_bc5ff513-a73b-44c9-bc56-e36cd25812cf/dns-node-resolver/0.log" Jun 02 02:47:52.600402 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.600379 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6bf3ecf5-7933-410f-8f76-f881f2cd6917-signing-cabundle\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.600483 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.600439 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkc86\" (UniqueName: \"kubernetes.io/projected/6bf3ecf5-7933-410f-8f76-f881f2cd6917-kube-api-access-vkc86\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.600524 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.600480 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6bf3ecf5-7933-410f-8f76-f881f2cd6917-signing-key\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.600996 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.600971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6bf3ecf5-7933-410f-8f76-f881f2cd6917-signing-cabundle\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.602834 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.602816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6bf3ecf5-7933-410f-8f76-f881f2cd6917-signing-key\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.609507 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.609484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkc86\" (UniqueName: \"kubernetes.io/projected/6bf3ecf5-7933-410f-8f76-f881f2cd6917-kube-api-access-vkc86\") pod \"service-ca-685df94d57-b6gsb\" (UID: \"6bf3ecf5-7933-410f-8f76-f881f2cd6917\") " pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.717053 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.717021 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-b6gsb" Jun 02 02:47:52.833669 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.833634 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-b6gsb"] Jun 02 02:47:52.837649 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:47:52.837620 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf3ecf5_7933_410f_8f76_f881f2cd6917.slice/crio-19375f5d4e0bd2d5d8818d84c299a2f221d80c5679222c3fb8e6249b89b8b9bb WatchSource:0}: Error finding container 19375f5d4e0bd2d5d8818d84c299a2f221d80c5679222c3fb8e6249b89b8b9bb: Status 404 returned error can't find the container with id 19375f5d4e0bd2d5d8818d84c299a2f221d80c5679222c3fb8e6249b89b8b9bb Jun 02 02:47:52.870956 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:52.870927 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-b6gsb" event={"ID":"6bf3ecf5-7933-410f-8f76-f881f2cd6917","Type":"ContainerStarted","Data":"19375f5d4e0bd2d5d8818d84c299a2f221d80c5679222c3fb8e6249b89b8b9bb"} Jun 02 02:47:53.306814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:53.306778 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:47:53.306980 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:53.306935 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:53.307025 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:53.307001 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls podName:83730f9b-72e3-45f3-9cfd-64f8faa37ea6 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:01.306984923 +0000 UTC m=+157.399519218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mrf8g" (UID: "83730f9b-72e3-45f3-9cfd-64f8faa37ea6") : secret "cluster-monitoring-operator-tls" not found Jun 02 02:47:53.608500 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:53.608424 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:47:53.608816 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:53.608559 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 02:47:53.608816 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:53.608619 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls podName:1498f5ee-ac12-48c5-b861-9b2e4c332b06 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:01.608603064 +0000 UTC m=+157.701137360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-fts26" (UID: "1498f5ee-ac12-48c5-b861-9b2e4c332b06") : secret "samples-operator-tls" not found Jun 02 02:47:53.709153 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:53.709106 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:53.709153 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:53.709159 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:47:53.709411 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:53.709257 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 02:47:53.709411 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:53.709315 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:01.70929713 +0000 UTC m=+157.801831432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : secret "router-metrics-certs-default" not found Jun 02 02:47:53.709411 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:47:53.709338 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle podName:90125e5f-aacc-4df5-9652-abdf545a10c5 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:01.709324651 +0000 UTC m=+157.801858946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle") pod "router-default-58886f6fcf-jfhqq" (UID: "90125e5f-aacc-4df5-9652-abdf545a10c5") : configmap references non-existent config key: service-ca.crt Jun 02 02:47:53.765987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:53.765957 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s274b_bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb/node-ca/0.log" Jun 02 02:47:53.874378 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:53.874298 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-b6gsb" event={"ID":"6bf3ecf5-7933-410f-8f76-f881f2cd6917","Type":"ContainerStarted","Data":"ffde3814cd2ae8231956084b65642bcefbfe087677b2e8744cca771e36e2af3b"} Jun 02 02:47:53.892612 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:47:53.892567 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-b6gsb" podStartSLOduration=1.892553076 podStartE2EDuration="1.892553076s" podCreationTimestamp="2026-06-02 02:47:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:47:53.891755482 +0000 UTC m=+149.984289802" watchObservedRunningTime="2026-06-02 02:47:53.892553076 +0000 UTC m=+149.985087422" Jun 02 02:48:00.881350 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:00.881296 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2l84v" podUID="43efa475-b2df-4f80-a9ab-3621f4e6a393" Jun 02 02:48:00.891473 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:00.891443 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-nd6nh" podUID="62adc8e6-67d7-4417-b182-8178137cce23" Jun 02 02:48:00.896736 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:00.893980 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2l84v" Jun 02 02:48:01.373460 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.373427 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:48:01.373622 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:01.373532 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 02:48:01.373622 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:01.373596 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls podName:83730f9b-72e3-45f3-9cfd-64f8faa37ea6 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:17.373582705 +0000 UTC m=+173.466117001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mrf8g" (UID: "83730f9b-72e3-45f3-9cfd-64f8faa37ea6") : secret "cluster-monitoring-operator-tls" not found Jun 02 02:48:01.675325 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.675224 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:48:01.677544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.677522 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1498f5ee-ac12-48c5-b861-9b2e4c332b06-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fts26\" (UID: \"1498f5ee-ac12-48c5-b861-9b2e4c332b06\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:48:01.700426 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.700398 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" Jun 02 02:48:01.776364 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.776276 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:01.776620 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.776530 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:01.777275 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.777253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90125e5f-aacc-4df5-9652-abdf545a10c5-service-ca-bundle\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:01.779177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.779154 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90125e5f-aacc-4df5-9652-abdf545a10c5-metrics-certs\") pod \"router-default-58886f6fcf-jfhqq\" (UID: \"90125e5f-aacc-4df5-9652-abdf545a10c5\") " pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:01.805240 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.805209 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:01.825831 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.825799 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26"] Jun 02 02:48:01.897771 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.897727 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" event={"ID":"1498f5ee-ac12-48c5-b861-9b2e4c332b06","Type":"ContainerStarted","Data":"df81cc201cb57fce32577a49f6b2e2a47a2e0c35d12ce0ba4260136c9a703e35"} Jun 02 02:48:01.927769 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:01.927695 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58886f6fcf-jfhqq"] Jun 02 02:48:01.931226 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:01.931189 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90125e5f_aacc_4df5_9652_abdf545a10c5.slice/crio-40782f977a3dcd27b8acfb9dfcafe7b659c208906dbe2fc6be7ca6d876eb331e WatchSource:0}: Error finding container 40782f977a3dcd27b8acfb9dfcafe7b659c208906dbe2fc6be7ca6d876eb331e: Status 404 returned error can't find the container with id 40782f977a3dcd27b8acfb9dfcafe7b659c208906dbe2fc6be7ca6d876eb331e Jun 02 02:48:02.454842 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:02.454798 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-69mdd" podUID="51ff4c93-dadf-4a56-9e65-645b1123c885" Jun 02 02:48:02.901465 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:02.901435 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" event={"ID":"90125e5f-aacc-4df5-9652-abdf545a10c5","Type":"ContainerStarted","Data":"9e2502dde1ebaf222cd973e17b8455a433d3be67581d8e9413e4b4dfa03ece32"} Jun 02 02:48:02.901465 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:02.901470 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" event={"ID":"90125e5f-aacc-4df5-9652-abdf545a10c5","Type":"ContainerStarted","Data":"40782f977a3dcd27b8acfb9dfcafe7b659c208906dbe2fc6be7ca6d876eb331e"} Jun 02 02:48:02.919586 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:02.919537 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" podStartSLOduration=17.919522356 podStartE2EDuration="17.919522356s" podCreationTimestamp="2026-06-02 02:47:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:48:02.918747977 +0000 UTC m=+159.011282296" watchObservedRunningTime="2026-06-02 02:48:02.919522356 +0000 UTC m=+159.012056711" Jun 02 02:48:03.805687 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:03.805662 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:03.808208 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:03.808184 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:03.905737 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:03.905707 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" event={"ID":"1498f5ee-ac12-48c5-b861-9b2e4c332b06","Type":"ContainerStarted","Data":"0f4d6e598dfbdf7b9cea085ea7d1262c39056afcea06ef341270607e62772dec"} Jun 02 02:48:03.906223 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:03.905741 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" event={"ID":"1498f5ee-ac12-48c5-b861-9b2e4c332b06","Type":"ContainerStarted","Data":"774f78da978f5625208399792be5135aa0bf61b133e4f876db41e1a956df2d42"} Jun 02 02:48:03.906223 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:03.906054 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:03.907114 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:03.907098 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58886f6fcf-jfhqq" Jun 02 02:48:03.920914 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:03.920835 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fts26" podStartSLOduration=17.064555268 podStartE2EDuration="18.920819956s" podCreationTimestamp="2026-06-02 02:47:45 +0000 UTC" firstStartedPulling="2026-06-02 02:48:01.88453052 +0000 UTC m=+157.977064817" lastFinishedPulling="2026-06-02 02:48:03.740795209 +0000 UTC m=+159.833329505" observedRunningTime="2026-06-02 02:48:03.92002581 +0000 UTC m=+160.012560129" watchObservedRunningTime="2026-06-02 02:48:03.920819956 +0000 UTC m=+160.013354273" Jun 02 02:48:05.806960 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:05.806925 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:48:05.807347 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:05.806987 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:48:05.809190 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:05.809163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43efa475-b2df-4f80-a9ab-3621f4e6a393-metrics-tls\") pod \"dns-default-2l84v\" (UID: \"43efa475-b2df-4f80-a9ab-3621f4e6a393\") " pod="openshift-dns/dns-default-2l84v" Jun 02 02:48:05.809462 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:05.809442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62adc8e6-67d7-4417-b182-8178137cce23-cert\") pod \"ingress-canary-nd6nh\" (UID: \"62adc8e6-67d7-4417-b182-8178137cce23\") " pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:48:05.997538 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:05.997502 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5469w\"" Jun 02 02:48:06.005733 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:06.005713 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2l84v" Jun 02 02:48:06.131928 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:06.131895 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2l84v"] Jun 02 02:48:06.134624 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:06.134589 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43efa475_b2df_4f80_a9ab_3621f4e6a393.slice/crio-9e14fe6eef919f521a29b256fcd9450e8b9c30bd81f1cd2df02c75ff3fc39e27 WatchSource:0}: Error finding container 9e14fe6eef919f521a29b256fcd9450e8b9c30bd81f1cd2df02c75ff3fc39e27: Status 404 returned error can't find the container with id 9e14fe6eef919f521a29b256fcd9450e8b9c30bd81f1cd2df02c75ff3fc39e27 Jun 02 02:48:06.915580 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:06.915536 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2l84v" event={"ID":"43efa475-b2df-4f80-a9ab-3621f4e6a393","Type":"ContainerStarted","Data":"9e14fe6eef919f521a29b256fcd9450e8b9c30bd81f1cd2df02c75ff3fc39e27"} Jun 02 02:48:07.919537 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:07.919502 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2l84v" event={"ID":"43efa475-b2df-4f80-a9ab-3621f4e6a393","Type":"ContainerStarted","Data":"ae90dac7925661321ffcc8832db2fbd2f058e05aa3c03ef336eb86e361493902"} Jun 02 02:48:07.919537 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:07.919542 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2l84v" event={"ID":"43efa475-b2df-4f80-a9ab-3621f4e6a393","Type":"ContainerStarted","Data":"9a1cded4a7b3bbb71f99d75119f6716780dc07daad1bec2e63c595fe9e4a0620"} Jun 02 02:48:07.919979 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:07.919670 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2l84v" Jun 02 02:48:07.935707 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:07.935663 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-2l84v" podStartSLOduration=129.763808556 podStartE2EDuration="2m10.935650245s" podCreationTimestamp="2026-06-02 02:45:57 +0000 UTC" firstStartedPulling="2026-06-02 02:48:06.136378169 +0000 UTC m=+162.228912465" lastFinishedPulling="2026-06-02 02:48:07.308219859 +0000 UTC m=+163.400754154" observedRunningTime="2026-06-02 02:48:07.934838369 +0000 UTC m=+164.027372687" watchObservedRunningTime="2026-06-02 02:48:07.935650245 +0000 UTC m=+164.028184562" Jun 02 02:48:14.882309 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.882281 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lrjsv"] Jun 02 02:48:14.885063 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.885047 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:14.887593 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.887574 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 02:48:14.888904 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.888856 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 02:48:14.888904 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.888875 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 02:48:14.889092 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.888875 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2sb7h\"" Jun 02 02:48:14.889092 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.888876 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 02:48:14.895910 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.895890 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrjsv"] Jun 02 02:48:14.970987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.970949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zn2g\" (UniqueName: \"kubernetes.io/projected/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-kube-api-access-6zn2g\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:14.971139 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.971073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-data-volume\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:14.971139 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.971133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:14.971229 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.971193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-crio-socket\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:14.971263 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.971228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:14.971817 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.971800 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bdbd5dcf6-dnkzn"] Jun 02 02:48:14.973812 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.973798 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:14.976386 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.976363 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 02:48:14.976497 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.976412 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bqz7l\"" Jun 02 02:48:14.976635 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.976622 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 02:48:14.976710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.976659 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 02:48:14.983645 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.983628 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 02:48:14.988899 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:14.988879 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdbd5dcf6-dnkzn"] Jun 02 02:48:15.071912 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.071876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-image-registry-private-configuration\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.071916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-bound-sa-token\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.071974 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-data-volume\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.072071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072004 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.072071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072029 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.072071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072056 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zn2g\" (UniqueName: \"kubernetes.io/projected/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-kube-api-access-6zn2g\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-registry-certificates\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmvr8\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-kube-api-access-rmvr8\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-ca-trust-extracted\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072218 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-crio-socket\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-trusted-ca\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-crio-socket\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-installation-pull-secrets\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-data-volume\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.072597 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-registry-tls\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.072597 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.072572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.074432 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.074410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.080899 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.080569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zn2g\" (UniqueName: \"kubernetes.io/projected/9d17f5f1-22b6-42aa-bceb-e20072a6a5af-kube-api-access-6zn2g\") pod \"insights-runtime-extractor-lrjsv\" (UID: \"9d17f5f1-22b6-42aa-bceb-e20072a6a5af\") " pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.172995 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.172907 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmvr8\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-kube-api-access-rmvr8\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.172995 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.172962 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-ca-trust-extracted\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.172995 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.172981 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-trusted-ca\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.173289 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.172999 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-installation-pull-secrets\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.173289 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.173016 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-registry-tls\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.173289 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.173036 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-image-registry-private-configuration\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.173289 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.173053 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-bound-sa-token\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.173289 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.173103 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-registry-certificates\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.173771 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.173526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-ca-trust-extracted\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.174065 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.174042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-trusted-ca\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.174177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.174080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-registry-certificates\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.175725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.175703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-image-registry-private-configuration\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.176142 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.176121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-installation-pull-secrets\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.176226 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.176187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-registry-tls\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.185538 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.185517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmvr8\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-kube-api-access-rmvr8\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.185663 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.185542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e66ac56b-dc4d-4711-a2c1-19e31789d8b1-bound-sa-token\") pod \"image-registry-bdbd5dcf6-dnkzn\" (UID: \"e66ac56b-dc4d-4711-a2c1-19e31789d8b1\") " pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.194413 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.194390 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrjsv" Jun 02 02:48:15.284142 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.284101 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.315135 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.314976 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrjsv"] Jun 02 02:48:15.318492 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:15.318466 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d17f5f1_22b6_42aa_bceb_e20072a6a5af.slice/crio-f9ae71e57d9379359889657916a1f26b4db7d2e46c4b4c62ee0b444aaef80c7f WatchSource:0}: Error finding container f9ae71e57d9379359889657916a1f26b4db7d2e46c4b4c62ee0b444aaef80c7f: Status 404 returned error can't find the container with id f9ae71e57d9379359889657916a1f26b4db7d2e46c4b4c62ee0b444aaef80c7f Jun 02 02:48:15.412461 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.412430 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdbd5dcf6-dnkzn"] Jun 02 02:48:15.416191 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:15.416158 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66ac56b_dc4d_4711_a2c1_19e31789d8b1.slice/crio-4f62ef7f1bdb74054785c6b712d5d45d4081497060730b77a0136535ba193cc4 WatchSource:0}: Error finding container 4f62ef7f1bdb74054785c6b712d5d45d4081497060730b77a0136535ba193cc4: Status 404 returned error can't find the container with id 4f62ef7f1bdb74054785c6b712d5d45d4081497060730b77a0136535ba193cc4 Jun 02 02:48:15.440646 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.440621 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:48:15.443407 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.443388 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kcfjp\"" Jun 02 02:48:15.451589 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.451570 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nd6nh" Jun 02 02:48:15.567134 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.567103 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nd6nh"] Jun 02 02:48:15.570010 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:15.569983 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62adc8e6_67d7_4417_b182_8178137cce23.slice/crio-dd1be615d4748ae04ae0483c86f0ba2eaabbe974aa0ac9a9ee981b6c6821e72f WatchSource:0}: Error finding container dd1be615d4748ae04ae0483c86f0ba2eaabbe974aa0ac9a9ee981b6c6821e72f: Status 404 returned error can't find the container with id dd1be615d4748ae04ae0483c86f0ba2eaabbe974aa0ac9a9ee981b6c6821e72f Jun 02 02:48:15.943922 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.943855 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrjsv" event={"ID":"9d17f5f1-22b6-42aa-bceb-e20072a6a5af","Type":"ContainerStarted","Data":"2387cfb82afde7ef99621bf56ed83921f5abee8a28f643440f29363844618f39"} Jun 02 02:48:15.944367 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.943934 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrjsv" event={"ID":"9d17f5f1-22b6-42aa-bceb-e20072a6a5af","Type":"ContainerStarted","Data":"f9ae71e57d9379359889657916a1f26b4db7d2e46c4b4c62ee0b444aaef80c7f"} Jun 02 02:48:15.945811 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.945779 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" event={"ID":"e66ac56b-dc4d-4711-a2c1-19e31789d8b1","Type":"ContainerStarted","Data":"f1ba97734f633878628899f2a70a81f2bbf9f0bd3faaa6dc1da9758cd5720a6f"} Jun 02 02:48:15.945963 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.945820 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" event={"ID":"e66ac56b-dc4d-4711-a2c1-19e31789d8b1","Type":"ContainerStarted","Data":"4f62ef7f1bdb74054785c6b712d5d45d4081497060730b77a0136535ba193cc4"} Jun 02 02:48:15.945963 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.945855 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:15.947160 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.947139 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nd6nh" event={"ID":"62adc8e6-67d7-4417-b182-8178137cce23","Type":"ContainerStarted","Data":"dd1be615d4748ae04ae0483c86f0ba2eaabbe974aa0ac9a9ee981b6c6821e72f"} Jun 02 02:48:15.964733 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:15.964668 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" podStartSLOduration=1.964648178 podStartE2EDuration="1.964648178s" podCreationTimestamp="2026-06-02 02:48:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:48:15.963176611 +0000 UTC m=+172.055710930" watchObservedRunningTime="2026-06-02 02:48:15.964648178 +0000 UTC m=+172.057182497" Jun 02 02:48:16.440956 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:16.440919 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:48:16.953126 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:16.953084 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrjsv" event={"ID":"9d17f5f1-22b6-42aa-bceb-e20072a6a5af","Type":"ContainerStarted","Data":"1429617326cc20ce6e03d18bc49a50a4762643846036cda8a76b55d30c8dd439"} Jun 02 02:48:17.391345 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.391294 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:48:17.394258 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.394231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83730f9b-72e3-45f3-9cfd-64f8faa37ea6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mrf8g\" (UID: \"83730f9b-72e3-45f3-9cfd-64f8faa37ea6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:48:17.608844 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.608764 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" Jun 02 02:48:17.876029 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.875978 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g"] Jun 02 02:48:17.878591 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:17.878568 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83730f9b_72e3_45f3_9cfd_64f8faa37ea6.slice/crio-5b27b9d2ccbd338d1c045f7042756d190987ae8c61a126739d23e1a968de5b6a WatchSource:0}: Error finding container 5b27b9d2ccbd338d1c045f7042756d190987ae8c61a126739d23e1a968de5b6a: Status 404 returned error can't find the container with id 5b27b9d2ccbd338d1c045f7042756d190987ae8c61a126739d23e1a968de5b6a Jun 02 02:48:17.923306 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.923284 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2l84v" Jun 02 02:48:17.957008 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.956979 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrjsv" event={"ID":"9d17f5f1-22b6-42aa-bceb-e20072a6a5af","Type":"ContainerStarted","Data":"1c34b82d58ee6e425a3bf4613f8dfc01be980541bdc482d7824fac3c6fa90511"} Jun 02 02:48:17.958113 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.958089 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" event={"ID":"83730f9b-72e3-45f3-9cfd-64f8faa37ea6","Type":"ContainerStarted","Data":"5b27b9d2ccbd338d1c045f7042756d190987ae8c61a126739d23e1a968de5b6a"} Jun 02 02:48:17.959410 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.959388 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nd6nh" event={"ID":"62adc8e6-67d7-4417-b182-8178137cce23","Type":"ContainerStarted","Data":"e3305aa83f5f24225a8464aaae9e39cf84a3ba7f317c7e32d5fc5f420ac18bb7"} Jun 02 02:48:17.978383 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:17.978342 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lrjsv" podStartSLOduration=1.584630486 podStartE2EDuration="3.978330547s" podCreationTimestamp="2026-06-02 02:48:14 +0000 UTC" firstStartedPulling="2026-06-02 02:48:15.39111139 +0000 UTC m=+171.483645692" lastFinishedPulling="2026-06-02 02:48:17.784811458 +0000 UTC m=+173.877345753" observedRunningTime="2026-06-02 02:48:17.978031793 +0000 UTC m=+174.070566117" watchObservedRunningTime="2026-06-02 02:48:17.978330547 +0000 UTC m=+174.070864864" Jun 02 02:48:18.000150 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:18.000115 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nd6nh" podStartSLOduration=139.397274697 podStartE2EDuration="2m21.000104383s" podCreationTimestamp="2026-06-02 02:45:57 +0000 UTC" firstStartedPulling="2026-06-02 02:48:15.571934986 +0000 UTC m=+171.664469281" lastFinishedPulling="2026-06-02 02:48:17.174764666 +0000 UTC m=+173.267298967" observedRunningTime="2026-06-02 02:48:17.998518265 +0000 UTC m=+174.091052582" watchObservedRunningTime="2026-06-02 02:48:18.000104383 +0000 UTC m=+174.092638787" Jun 02 02:48:19.966122 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:19.966085 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" event={"ID":"83730f9b-72e3-45f3-9cfd-64f8faa37ea6","Type":"ContainerStarted","Data":"0e58350a5102ce0ded628d927d5aca4dc9a69e599e89d3529c4201169376f199"} Jun 02 02:48:19.991939 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:19.991848 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mrf8g" podStartSLOduration=33.412631252 podStartE2EDuration="34.991830211s" podCreationTimestamp="2026-06-02 02:47:45 +0000 UTC" firstStartedPulling="2026-06-02 02:48:17.880368792 +0000 UTC m=+173.972903088" lastFinishedPulling="2026-06-02 02:48:19.45956775 +0000 UTC m=+175.552102047" observedRunningTime="2026-06-02 02:48:19.991646038 +0000 UTC m=+176.084180370" watchObservedRunningTime="2026-06-02 02:48:19.991830211 +0000 UTC m=+176.084364533" Jun 02 02:48:24.423334 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.423307 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7ffbccb7-dq6rx"] Jun 02 02:48:24.429369 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.429351 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.432227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.432204 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 02:48:24.432335 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.432230 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 02:48:24.432335 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.432213 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 02:48:24.433368 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.433352 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 02:48:24.433468 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.433404 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 02:48:24.433529 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.433447 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 02:48:24.433529 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.433451 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rcdq4\"" Jun 02 02:48:24.433670 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.433653 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 02:48:24.438310 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.438289 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 02:48:24.438493 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.438475 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7ffbccb7-dq6rx"] Jun 02 02:48:24.541715 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.541686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-config\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.541715 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.541716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-service-ca\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.541930 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.541752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-serving-cert\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.541930 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.541778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-oauth-config\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.541930 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.541799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn7np\" (UniqueName: \"kubernetes.io/projected/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-kube-api-access-wn7np\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.541930 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.541841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-oauth-serving-cert\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.542066 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.541920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-trusted-ca-bundle\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643000 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.642973 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-trusted-ca-bundle\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643103 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643004 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-config\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643103 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643023 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-service-ca\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643103 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643076 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-serving-cert\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643243 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643107 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-oauth-config\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643243 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643135 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn7np\" (UniqueName: \"kubernetes.io/projected/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-kube-api-access-wn7np\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643243 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643195 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-oauth-serving-cert\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643760 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643737 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-service-ca\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643878 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-config\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643878 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-oauth-serving-cert\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.643979 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.643961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-trusted-ca-bundle\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.646034 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.646012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-oauth-config\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.646136 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.646120 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-serving-cert\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.651524 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.651501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn7np\" (UniqueName: \"kubernetes.io/projected/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-kube-api-access-wn7np\") pod \"console-7d7ffbccb7-dq6rx\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.738188 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.738167 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:24.857753 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.857724 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7ffbccb7-dq6rx"] Jun 02 02:48:24.861286 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:24.861259 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11399bf2_2658_4ccf_ab67_67ca1a62fd6d.slice/crio-e24b3524f5dfee705c0a0ee02c601b960b95b8f5375a1d25809cd4502ac8b71a WatchSource:0}: Error finding container e24b3524f5dfee705c0a0ee02c601b960b95b8f5375a1d25809cd4502ac8b71a: Status 404 returned error can't find the container with id e24b3524f5dfee705c0a0ee02c601b960b95b8f5375a1d25809cd4502ac8b71a Jun 02 02:48:24.979054 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:24.979020 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7ffbccb7-dq6rx" event={"ID":"11399bf2-2658-4ccf-ab67-67ca1a62fd6d","Type":"ContainerStarted","Data":"e24b3524f5dfee705c0a0ee02c601b960b95b8f5375a1d25809cd4502ac8b71a"} Jun 02 02:48:25.050916 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.050830 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7"] Jun 02 02:48:25.053577 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.053561 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.056196 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.056162 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 02:48:25.056196 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.056182 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 02:48:25.056196 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.056184 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-d7rbn\"" Jun 02 02:48:25.056352 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.056166 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 02:48:25.067396 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.067374 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7"] Jun 02 02:48:25.145993 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.145959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7dhm\" (UniqueName: \"kubernetes.io/projected/34eff1e7-b87f-4395-a50e-a80acb03da35-kube-api-access-v7dhm\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.145993 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.145999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/34eff1e7-b87f-4395-a50e-a80acb03da35-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.146221 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.146034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34eff1e7-b87f-4395-a50e-a80acb03da35-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.146221 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.146093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34eff1e7-b87f-4395-a50e-a80acb03da35-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.247126 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.247091 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34eff1e7-b87f-4395-a50e-a80acb03da35-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.247307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.247144 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34eff1e7-b87f-4395-a50e-a80acb03da35-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.247307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.247213 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7dhm\" (UniqueName: \"kubernetes.io/projected/34eff1e7-b87f-4395-a50e-a80acb03da35-kube-api-access-v7dhm\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.247307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.247240 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/34eff1e7-b87f-4395-a50e-a80acb03da35-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.247808 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.247787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34eff1e7-b87f-4395-a50e-a80acb03da35-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.249405 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.249380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34eff1e7-b87f-4395-a50e-a80acb03da35-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.249539 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.249521 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/34eff1e7-b87f-4395-a50e-a80acb03da35-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.257790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.257770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7dhm\" (UniqueName: \"kubernetes.io/projected/34eff1e7-b87f-4395-a50e-a80acb03da35-kube-api-access-v7dhm\") pod \"prometheus-operator-658bcd8bdf-hzjr7\" (UID: \"34eff1e7-b87f-4395-a50e-a80acb03da35\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.366574 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.366495 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" Jun 02 02:48:25.508559 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.508533 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7"] Jun 02 02:48:25.512505 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:25.512474 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34eff1e7_b87f_4395_a50e_a80acb03da35.slice/crio-c167294b74940e859c63cf09c99528f4a9bb99d468748248872f4d381f88ef5b WatchSource:0}: Error finding container c167294b74940e859c63cf09c99528f4a9bb99d468748248872f4d381f88ef5b: Status 404 returned error can't find the container with id c167294b74940e859c63cf09c99528f4a9bb99d468748248872f4d381f88ef5b Jun 02 02:48:25.984289 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:25.984247 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" event={"ID":"34eff1e7-b87f-4395-a50e-a80acb03da35","Type":"ContainerStarted","Data":"c167294b74940e859c63cf09c99528f4a9bb99d468748248872f4d381f88ef5b"} Jun 02 02:48:27.990892 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:27.990846 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7ffbccb7-dq6rx" event={"ID":"11399bf2-2658-4ccf-ab67-67ca1a62fd6d","Type":"ContainerStarted","Data":"50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e"} Jun 02 02:48:27.992578 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:27.992529 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" event={"ID":"34eff1e7-b87f-4395-a50e-a80acb03da35","Type":"ContainerStarted","Data":"01639bfd36a68d80ce7e3dc0280566077b5de736383a80694dbfd7362d93afa8"} Jun 02 02:48:27.992578 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:27.992559 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" event={"ID":"34eff1e7-b87f-4395-a50e-a80acb03da35","Type":"ContainerStarted","Data":"f041e4d2d910bf7ddf491888e6187e5d96c0f5b08425ed3584d904ead8d8b2dd"} Jun 02 02:48:28.012605 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:28.012558 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d7ffbccb7-dq6rx" podStartSLOduration=1.05460384 podStartE2EDuration="4.012547572s" podCreationTimestamp="2026-06-02 02:48:24 +0000 UTC" firstStartedPulling="2026-06-02 02:48:24.863473454 +0000 UTC m=+180.956007753" lastFinishedPulling="2026-06-02 02:48:27.821417186 +0000 UTC m=+183.913951485" observedRunningTime="2026-06-02 02:48:28.01179489 +0000 UTC m=+184.104329208" watchObservedRunningTime="2026-06-02 02:48:28.012547572 +0000 UTC m=+184.105081933" Jun 02 02:48:28.030280 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:28.030234 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hzjr7" podStartSLOduration=0.729519075 podStartE2EDuration="3.030221061s" podCreationTimestamp="2026-06-02 02:48:25 +0000 UTC" firstStartedPulling="2026-06-02 02:48:25.514392116 +0000 UTC m=+181.606926412" lastFinishedPulling="2026-06-02 02:48:27.815094099 +0000 UTC m=+183.907628398" observedRunningTime="2026-06-02 02:48:28.029229115 +0000 UTC m=+184.121763436" watchObservedRunningTime="2026-06-02 02:48:28.030221061 +0000 UTC m=+184.122755379" Jun 02 02:48:30.437802 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.437771 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hl9xn"] Jun 02 02:48:30.441600 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.441569 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.444405 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.444375 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mcxww\"" Jun 02 02:48:30.445711 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.445550 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 02:48:30.445711 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.445672 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 02:48:30.446112 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.446022 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 02:48:30.494945 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.494908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-textfile\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495124 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.494967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31c8a03f-1102-4643-90c3-47eab34acbe3-metrics-client-ca\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495124 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.494994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4lfz\" (UniqueName: \"kubernetes.io/projected/31c8a03f-1102-4643-90c3-47eab34acbe3-kube-api-access-w4lfz\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495124 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.495018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-wtmp\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495124 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.495040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.495166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-sys\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.495202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.495248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-root\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.495326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.495276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596460 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596420 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-root\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596474 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596517 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-textfile\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596532 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-root\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596562 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31c8a03f-1102-4643-90c3-47eab34acbe3-metrics-client-ca\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596588 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4lfz\" (UniqueName: \"kubernetes.io/projected/31c8a03f-1102-4643-90c3-47eab34acbe3-kube-api-access-w4lfz\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596613 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-wtmp\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.596643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596639 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.597027 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596698 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-sys\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.597027 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596722 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.597027 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:30.596829 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 02:48:30.597027 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:30.596900 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls podName:31c8a03f-1102-4643-90c3-47eab34acbe3 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:31.096880937 +0000 UTC m=+187.189415241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls") pod "node-exporter-hl9xn" (UID: "31c8a03f-1102-4643-90c3-47eab34acbe3") : secret "node-exporter-tls" not found Jun 02 02:48:30.597027 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.596978 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-textfile\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.597288 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.597098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-sys\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.597439 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.597417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31c8a03f-1102-4643-90c3-47eab34acbe3-metrics-client-ca\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.597508 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.597475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.597641 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.597620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-wtmp\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.599523 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.599496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:30.607047 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:30.607012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4lfz\" (UniqueName: \"kubernetes.io/projected/31c8a03f-1102-4643-90c3-47eab34acbe3-kube-api-access-w4lfz\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:31.101422 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:31.101382 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:31.101614 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:31.101562 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 02:48:31.101683 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:48:31.101638 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls podName:31c8a03f-1102-4643-90c3-47eab34acbe3 nodeName:}" failed. No retries permitted until 2026-06-02 02:48:32.101619177 +0000 UTC m=+188.194153476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls") pod "node-exporter-hl9xn" (UID: "31c8a03f-1102-4643-90c3-47eab34acbe3") : secret "node-exporter-tls" not found Jun 02 02:48:32.112182 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:32.112145 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:32.114722 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:32.114694 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31c8a03f-1102-4643-90c3-47eab34acbe3-node-exporter-tls\") pod \"node-exporter-hl9xn\" (UID: \"31c8a03f-1102-4643-90c3-47eab34acbe3\") " pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:32.252553 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:32.252518 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hl9xn" Jun 02 02:48:32.262580 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:32.262550 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c8a03f_1102_4643_90c3_47eab34acbe3.slice/crio-e451562158b2bc72a6671eaa1c8c4d192f774a5327bf9f36637bca39e1fbe9a4 WatchSource:0}: Error finding container e451562158b2bc72a6671eaa1c8c4d192f774a5327bf9f36637bca39e1fbe9a4: Status 404 returned error can't find the container with id e451562158b2bc72a6671eaa1c8c4d192f774a5327bf9f36637bca39e1fbe9a4 Jun 02 02:48:33.007149 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:33.007110 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl9xn" event={"ID":"31c8a03f-1102-4643-90c3-47eab34acbe3","Type":"ContainerStarted","Data":"e451562158b2bc72a6671eaa1c8c4d192f774a5327bf9f36637bca39e1fbe9a4"} Jun 02 02:48:34.011402 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.011365 2577 generic.go:358] "Generic (PLEG): container finished" podID="31c8a03f-1102-4643-90c3-47eab34acbe3" containerID="31e5ab464a275bfb530628cf99810cc3cd070a603c321a8ca9c1597f08b50bd0" exitCode=0 Jun 02 02:48:34.011768 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.011457 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl9xn" event={"ID":"31c8a03f-1102-4643-90c3-47eab34acbe3","Type":"ContainerDied","Data":"31e5ab464a275bfb530628cf99810cc3cd070a603c321a8ca9c1597f08b50bd0"} Jun 02 02:48:34.739030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.739000 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:34.739171 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.739042 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:34.744226 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.744200 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:34.910042 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.910012 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dd8b6f5f9-kmt58"] Jun 02 02:48:34.914429 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.914413 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:34.917301 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.917253 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z7jqx\"" Jun 02 02:48:34.917301 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.917286 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 02:48:34.917490 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.917308 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 02:48:34.917490 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.917438 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 02:48:34.917490 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.917447 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f6k20r8j8ts4g\"" Jun 02 02:48:34.917600 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.917566 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 02:48:34.922231 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:34.922208 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dd8b6f5f9-kmt58"] Jun 02 02:48:35.016853 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.016769 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl9xn" event={"ID":"31c8a03f-1102-4643-90c3-47eab34acbe3","Type":"ContainerStarted","Data":"5760ff2c10160dcca22f0557d9463130efbbfbf2155e74e9ccdf58bb2aed374e"} Jun 02 02:48:35.016853 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.016807 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl9xn" event={"ID":"31c8a03f-1102-4643-90c3-47eab34acbe3","Type":"ContainerStarted","Data":"c071f69ebc32c9bd722abd6c1219d589b3dd7245b247e68d1e39214e2766ba0f"} Jun 02 02:48:35.020634 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.020617 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:48:35.035967 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.035924 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hl9xn" podStartSLOduration=4.069840149 podStartE2EDuration="5.035912127s" podCreationTimestamp="2026-06-02 02:48:30 +0000 UTC" firstStartedPulling="2026-06-02 02:48:32.264804486 +0000 UTC m=+188.357338786" lastFinishedPulling="2026-06-02 02:48:33.230876454 +0000 UTC m=+189.323410764" observedRunningTime="2026-06-02 02:48:35.035147304 +0000 UTC m=+191.127681625" watchObservedRunningTime="2026-06-02 02:48:35.035912127 +0000 UTC m=+191.128446444" Jun 02 02:48:35.036725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.036708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-secret-metrics-server-client-certs\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.036784 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.036745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e68a3451-b9bd-4db9-abec-678da55e2880-audit-log\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.036784 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.036765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-secret-metrics-server-tls\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.036886 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.036843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68a3451-b9bd-4db9-abec-678da55e2880-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.036920 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.036887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prwdg\" (UniqueName: \"kubernetes.io/projected/e68a3451-b9bd-4db9-abec-678da55e2880-kube-api-access-prwdg\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.036920 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.036911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-client-ca-bundle\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.036990 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.036947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e68a3451-b9bd-4db9-abec-678da55e2880-metrics-server-audit-profiles\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.137511 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.137480 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-client-ca-bundle\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.137663 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.137562 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e68a3451-b9bd-4db9-abec-678da55e2880-metrics-server-audit-profiles\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.137663 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.137629 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-secret-metrics-server-client-certs\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.137780 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.137726 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e68a3451-b9bd-4db9-abec-678da55e2880-audit-log\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.137839 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.137788 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-secret-metrics-server-tls\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.138403 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.138330 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68a3451-b9bd-4db9-abec-678da55e2880-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.138403 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.138387 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prwdg\" (UniqueName: \"kubernetes.io/projected/e68a3451-b9bd-4db9-abec-678da55e2880-kube-api-access-prwdg\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.139015 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.138987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e68a3451-b9bd-4db9-abec-678da55e2880-metrics-server-audit-profiles\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.139136 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.138985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e68a3451-b9bd-4db9-abec-678da55e2880-audit-log\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.139243 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.139229 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68a3451-b9bd-4db9-abec-678da55e2880-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.140503 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.140481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-client-ca-bundle\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.140638 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.140616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-secret-metrics-server-client-certs\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.140706 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.140691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e68a3451-b9bd-4db9-abec-678da55e2880-secret-metrics-server-tls\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.155133 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.155104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prwdg\" (UniqueName: \"kubernetes.io/projected/e68a3451-b9bd-4db9-abec-678da55e2880-kube-api-access-prwdg\") pod \"metrics-server-dd8b6f5f9-kmt58\" (UID: \"e68a3451-b9bd-4db9-abec-678da55e2880\") " pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.226134 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.226091 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:35.354723 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.354695 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dd8b6f5f9-kmt58"] Jun 02 02:48:35.357584 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:35.357550 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68a3451_b9bd_4db9_abec_678da55e2880.slice/crio-c359d915a654996cd671f0edd836be6d49caac7fc5bb332638e8abcc7da6751e WatchSource:0}: Error finding container c359d915a654996cd671f0edd836be6d49caac7fc5bb332638e8abcc7da6751e: Status 404 returned error can't find the container with id c359d915a654996cd671f0edd836be6d49caac7fc5bb332638e8abcc7da6751e Jun 02 02:48:35.639294 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.639220 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q"] Jun 02 02:48:35.642326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.642311 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.645399 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.645375 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 02:48:35.645399 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.645385 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 02:48:35.645399 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.645396 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rpgms\"" Jun 02 02:48:35.645683 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.645388 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 02:48:35.645683 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.645384 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 02:48:35.645773 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.645761 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 02:48:35.653527 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.653503 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 02:48:35.656423 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.656403 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q"] Jun 02 02:48:35.743449 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-metrics-client-ca\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.743550 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnd68\" (UniqueName: \"kubernetes.io/projected/f558249d-8baf-4205-b0de-6d2346386497-kube-api-access-nnd68\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.743550 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.743622 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-serving-certs-ca-bundle\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.743622 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.743683 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-telemeter-client-tls\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.743683 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-federate-client-tls\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.743683 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.743661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-secret-telemeter-client\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.844676 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.844645 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-telemeter-client-tls\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.844876 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.844691 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-federate-client-tls\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.844876 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.844826 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-secret-telemeter-client\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.844985 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.844939 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-metrics-client-ca\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.845045 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.845033 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnd68\" (UniqueName: \"kubernetes.io/projected/f558249d-8baf-4205-b0de-6d2346386497-kube-api-access-nnd68\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.845098 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.845065 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.845152 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.845101 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-serving-certs-ca-bundle\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.845152 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.845128 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.845746 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.845695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-metrics-client-ca\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.846012 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.845953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-serving-certs-ca-bundle\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.846012 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.845969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f558249d-8baf-4205-b0de-6d2346386497-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.847671 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.847644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-secret-telemeter-client\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.847793 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.847731 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-telemeter-client-tls\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.847793 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.847762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-federate-client-tls\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.848142 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.848114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f558249d-8baf-4205-b0de-6d2346386497-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.858112 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.858090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnd68\" (UniqueName: \"kubernetes.io/projected/f558249d-8baf-4205-b0de-6d2346386497-kube-api-access-nnd68\") pod \"telemeter-client-7cd7d4b67c-hlk8q\" (UID: \"f558249d-8baf-4205-b0de-6d2346386497\") " pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:35.953700 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:35.953634 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" Jun 02 02:48:36.022429 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:36.022352 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" event={"ID":"e68a3451-b9bd-4db9-abec-678da55e2880","Type":"ContainerStarted","Data":"c359d915a654996cd671f0edd836be6d49caac7fc5bb332638e8abcc7da6751e"} Jun 02 02:48:36.092778 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:36.092665 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q"] Jun 02 02:48:36.095041 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:36.095001 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf558249d_8baf_4205_b0de_6d2346386497.slice/crio-45964ee52acd7e35739cf183f775c859a705c9d15722e9e1d2b9f9ef3b570234 WatchSource:0}: Error finding container 45964ee52acd7e35739cf183f775c859a705c9d15722e9e1d2b9f9ef3b570234: Status 404 returned error can't find the container with id 45964ee52acd7e35739cf183f775c859a705c9d15722e9e1d2b9f9ef3b570234 Jun 02 02:48:36.958262 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:36.958229 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bdbd5dcf6-dnkzn" Jun 02 02:48:37.026706 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:37.026674 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" event={"ID":"e68a3451-b9bd-4db9-abec-678da55e2880","Type":"ContainerStarted","Data":"44b74760690e3ca067c5cd33979a0a646a5ccc6190875784e1bdf9b4725d30c8"} Jun 02 02:48:37.027916 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:37.027890 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" event={"ID":"f558249d-8baf-4205-b0de-6d2346386497","Type":"ContainerStarted","Data":"45964ee52acd7e35739cf183f775c859a705c9d15722e9e1d2b9f9ef3b570234"} Jun 02 02:48:37.047111 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:37.047049 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" podStartSLOduration=1.452515925 podStartE2EDuration="3.047029998s" podCreationTimestamp="2026-06-02 02:48:34 +0000 UTC" firstStartedPulling="2026-06-02 02:48:35.359397907 +0000 UTC m=+191.451932203" lastFinishedPulling="2026-06-02 02:48:36.953911965 +0000 UTC m=+193.046446276" observedRunningTime="2026-06-02 02:48:37.046362853 +0000 UTC m=+193.138897185" watchObservedRunningTime="2026-06-02 02:48:37.047029998 +0000 UTC m=+193.139564319" Jun 02 02:48:39.034488 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:39.034451 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" event={"ID":"f558249d-8baf-4205-b0de-6d2346386497","Type":"ContainerStarted","Data":"d0cac8632f288e803693d84fe3fb1ab272d1ffaa71ea6512c5b2e45e47e453b3"} Jun 02 02:48:40.039116 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:40.039076 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" event={"ID":"f558249d-8baf-4205-b0de-6d2346386497","Type":"ContainerStarted","Data":"7d25428fe05d0f0544f1b1bbdb58522be4476828302a2bfa0bfea012744c5f6b"} Jun 02 02:48:40.039116 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:40.039112 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" event={"ID":"f558249d-8baf-4205-b0de-6d2346386497","Type":"ContainerStarted","Data":"4e781d53f34ca0e79226d800f7fd302bc7261558bc99102ed361673ddbd70ef9"} Jun 02 02:48:40.063379 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:40.063337 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cd7d4b67c-hlk8q" podStartSLOduration=2.099494369 podStartE2EDuration="5.063324396s" podCreationTimestamp="2026-06-02 02:48:35 +0000 UTC" firstStartedPulling="2026-06-02 02:48:36.097020173 +0000 UTC m=+192.189554468" lastFinishedPulling="2026-06-02 02:48:39.060850196 +0000 UTC m=+195.153384495" observedRunningTime="2026-06-02 02:48:40.062882634 +0000 UTC m=+196.155416951" watchObservedRunningTime="2026-06-02 02:48:40.063324396 +0000 UTC m=+196.155858713" Jun 02 02:48:40.936427 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:40.936391 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-78dbb7f6dc-dz78k"] Jun 02 02:48:40.939156 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:40.939135 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:40.947415 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:40.947395 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dbb7f6dc-dz78k"] Jun 02 02:48:41.094058 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.094024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-serving-cert\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.094058 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.094068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-oauth-config\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.094522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.094163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-trusted-ca-bundle\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.094522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.094187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-service-ca\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.094522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.094206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql5ff\" (UniqueName: \"kubernetes.io/projected/634c1039-1c24-4532-aa1d-5a125c6e2df8-kube-api-access-ql5ff\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.094522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.094238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-oauth-serving-cert\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.094522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.094309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-config\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.195636 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.195558 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-serving-cert\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.195636 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.195584 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-oauth-config\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.195888 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.195800 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-trusted-ca-bundle\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.195964 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.195893 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-service-ca\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.196190 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.196165 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ql5ff\" (UniqueName: \"kubernetes.io/projected/634c1039-1c24-4532-aa1d-5a125c6e2df8-kube-api-access-ql5ff\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.196307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.196288 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-oauth-serving-cert\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.196472 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.196458 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-config\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.197331 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.197311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-config\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.197470 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.197401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-service-ca\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.197879 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.197835 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-oauth-serving-cert\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.198026 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.197900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-trusted-ca-bundle\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.198878 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.198840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-oauth-config\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.202467 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.202447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-serving-cert\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.206539 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.206520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql5ff\" (UniqueName: \"kubernetes.io/projected/634c1039-1c24-4532-aa1d-5a125c6e2df8-kube-api-access-ql5ff\") pod \"console-78dbb7f6dc-dz78k\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.249049 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.249006 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:41.371464 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:41.371435 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78dbb7f6dc-dz78k"] Jun 02 02:48:41.373791 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:48:41.373766 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634c1039_1c24_4532_aa1d_5a125c6e2df8.slice/crio-8fbb8ebeb92d10db9bf5ac969245107e691e5174661ecf49839343f5b5578ee4 WatchSource:0}: Error finding container 8fbb8ebeb92d10db9bf5ac969245107e691e5174661ecf49839343f5b5578ee4: Status 404 returned error can't find the container with id 8fbb8ebeb92d10db9bf5ac969245107e691e5174661ecf49839343f5b5578ee4 Jun 02 02:48:42.045163 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:42.045122 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dbb7f6dc-dz78k" event={"ID":"634c1039-1c24-4532-aa1d-5a125c6e2df8","Type":"ContainerStarted","Data":"96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3"} Jun 02 02:48:42.045163 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:42.045163 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dbb7f6dc-dz78k" event={"ID":"634c1039-1c24-4532-aa1d-5a125c6e2df8","Type":"ContainerStarted","Data":"8fbb8ebeb92d10db9bf5ac969245107e691e5174661ecf49839343f5b5578ee4"} Jun 02 02:48:42.066030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:42.065983 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-78dbb7f6dc-dz78k" podStartSLOduration=2.065969339 podStartE2EDuration="2.065969339s" podCreationTimestamp="2026-06-02 02:48:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:48:42.064601839 +0000 UTC m=+198.157136158" watchObservedRunningTime="2026-06-02 02:48:42.065969339 +0000 UTC m=+198.158503657" Jun 02 02:48:51.249924 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:51.249881 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:51.250322 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:51.249942 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:51.254910 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:51.254887 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:52.076630 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:52.076601 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:48:52.125099 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:52.125068 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7ffbccb7-dq6rx"] Jun 02 02:48:55.226598 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:55.226570 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:48:55.226951 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:48:55.226610 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:49:15.136680 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:15.136647 2577 generic.go:358] "Generic (PLEG): container finished" podID="abae0371-67a2-4db3-b5aa-2e02157a52ec" containerID="e3448c9e865fa3ba481d772846af0dba3037d48e62e42a0e1d3da7bd61fe6514" exitCode=0 Jun 02 02:49:15.137071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:15.136710 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" event={"ID":"abae0371-67a2-4db3-b5aa-2e02157a52ec","Type":"ContainerDied","Data":"e3448c9e865fa3ba481d772846af0dba3037d48e62e42a0e1d3da7bd61fe6514"} Jun 02 02:49:15.137071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:15.137019 2577 scope.go:117] "RemoveContainer" containerID="e3448c9e865fa3ba481d772846af0dba3037d48e62e42a0e1d3da7bd61fe6514" Jun 02 02:49:15.232796 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:15.232765 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:49:15.236787 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:15.236762 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dd8b6f5f9-kmt58" Jun 02 02:49:16.142263 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:16.142224 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-h65cd" event={"ID":"abae0371-67a2-4db3-b5aa-2e02157a52ec","Type":"ContainerStarted","Data":"cb01a10bd6bcf7d0e254fb74cec18ff5ed95837ef5612881c8240efd0542fabe"} Jun 02 02:49:17.150922 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.150885 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7d7ffbccb7-dq6rx" podUID="11399bf2-2658-4ccf-ab67-67ca1a62fd6d" containerName="console" containerID="cri-o://50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e" gracePeriod=15 Jun 02 02:49:17.387335 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.387314 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d7ffbccb7-dq6rx_11399bf2-2658-4ccf-ab67-67ca1a62fd6d/console/0.log" Jun 02 02:49:17.387451 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.387383 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:49:17.507923 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.507891 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-service-ca\") pod \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " Jun 02 02:49:17.508177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.507936 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn7np\" (UniqueName: \"kubernetes.io/projected/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-kube-api-access-wn7np\") pod \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " Jun 02 02:49:17.508177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.507964 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-trusted-ca-bundle\") pod \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " Jun 02 02:49:17.508177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.507993 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-config\") pod \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " Jun 02 02:49:17.508177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.508045 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-serving-cert\") pod \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " Jun 02 02:49:17.508177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.508068 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-oauth-serving-cert\") pod \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " Jun 02 02:49:17.508177 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.508101 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-oauth-config\") pod \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\" (UID: \"11399bf2-2658-4ccf-ab67-67ca1a62fd6d\") " Jun 02 02:49:17.508468 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.508377 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-service-ca" (OuterVolumeSpecName: "service-ca") pod "11399bf2-2658-4ccf-ab67-67ca1a62fd6d" (UID: "11399bf2-2658-4ccf-ab67-67ca1a62fd6d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:49:17.508468 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.508448 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-config" (OuterVolumeSpecName: "console-config") pod "11399bf2-2658-4ccf-ab67-67ca1a62fd6d" (UID: "11399bf2-2658-4ccf-ab67-67ca1a62fd6d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:49:17.508602 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.508578 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11399bf2-2658-4ccf-ab67-67ca1a62fd6d" (UID: "11399bf2-2658-4ccf-ab67-67ca1a62fd6d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:49:17.508684 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.508663 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11399bf2-2658-4ccf-ab67-67ca1a62fd6d" (UID: "11399bf2-2658-4ccf-ab67-67ca1a62fd6d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:49:17.510334 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.510300 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11399bf2-2658-4ccf-ab67-67ca1a62fd6d" (UID: "11399bf2-2658-4ccf-ab67-67ca1a62fd6d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:49:17.510334 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.510323 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-kube-api-access-wn7np" (OuterVolumeSpecName: "kube-api-access-wn7np") pod "11399bf2-2658-4ccf-ab67-67ca1a62fd6d" (UID: "11399bf2-2658-4ccf-ab67-67ca1a62fd6d"). InnerVolumeSpecName "kube-api-access-wn7np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:49:17.510474 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.510315 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11399bf2-2658-4ccf-ab67-67ca1a62fd6d" (UID: "11399bf2-2658-4ccf-ab67-67ca1a62fd6d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:49:17.609215 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.609179 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-oauth-config\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:49:17.609215 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.609210 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-service-ca\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:49:17.609215 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.609220 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn7np\" (UniqueName: \"kubernetes.io/projected/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-kube-api-access-wn7np\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:49:17.609443 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.609230 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-trusted-ca-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:49:17.609443 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.609239 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-config\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:49:17.609443 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.609247 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-console-serving-cert\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:49:17.609443 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:17.609255 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11399bf2-2658-4ccf-ab67-67ca1a62fd6d-oauth-serving-cert\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:49:18.148697 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.148667 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d7ffbccb7-dq6rx_11399bf2-2658-4ccf-ab67-67ca1a62fd6d/console/0.log" Jun 02 02:49:18.148882 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.148704 2577 generic.go:358] "Generic (PLEG): container finished" podID="11399bf2-2658-4ccf-ab67-67ca1a62fd6d" containerID="50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e" exitCode=2 Jun 02 02:49:18.148882 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.148738 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7ffbccb7-dq6rx" event={"ID":"11399bf2-2658-4ccf-ab67-67ca1a62fd6d","Type":"ContainerDied","Data":"50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e"} Jun 02 02:49:18.148882 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.148765 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7ffbccb7-dq6rx" Jun 02 02:49:18.148882 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.148775 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7ffbccb7-dq6rx" event={"ID":"11399bf2-2658-4ccf-ab67-67ca1a62fd6d","Type":"ContainerDied","Data":"e24b3524f5dfee705c0a0ee02c601b960b95b8f5375a1d25809cd4502ac8b71a"} Jun 02 02:49:18.148882 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.148789 2577 scope.go:117] "RemoveContainer" containerID="50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e" Jun 02 02:49:18.157091 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.157074 2577 scope.go:117] "RemoveContainer" containerID="50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e" Jun 02 02:49:18.157372 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:49:18.157353 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e\": container with ID starting with 50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e not found: ID does not exist" containerID="50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e" Jun 02 02:49:18.157438 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.157384 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e"} err="failed to get container status \"50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e\": rpc error: code = NotFound desc = could not find container \"50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e\": container with ID starting with 50d36cd0d7af9ca109afb5c70b661285dd82feb053d68fd2757a6ff4a7aa9e0e not found: ID does not exist" Jun 02 02:49:18.170606 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.170587 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7ffbccb7-dq6rx"] Jun 02 02:49:18.174087 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.174068 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7ffbccb7-dq6rx"] Jun 02 02:49:18.444466 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:18.444398 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11399bf2-2658-4ccf-ab67-67ca1a62fd6d" path="/var/lib/kubelet/pods/11399bf2-2658-4ccf-ab67-67ca1a62fd6d/volumes" Jun 02 02:49:36.172317 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:36.172225 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:49:36.174489 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:36.174466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51ff4c93-dadf-4a56-9e65-645b1123c885-metrics-certs\") pod \"network-metrics-daemon-69mdd\" (UID: \"51ff4c93-dadf-4a56-9e65-645b1123c885\") " pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:49:36.244495 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:36.244471 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bgk2p\"" Jun 02 02:49:36.252487 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:36.252471 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-69mdd" Jun 02 02:49:36.370797 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:36.370697 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-69mdd"] Jun 02 02:49:36.373340 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:49:36.373301 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ff4c93_dadf_4a56_9e65_645b1123c885.slice/crio-4489d5a0d4611c005f5f312dbc34534c0e6fbd685f5de34a19605e7fc8115b85 WatchSource:0}: Error finding container 4489d5a0d4611c005f5f312dbc34534c0e6fbd685f5de34a19605e7fc8115b85: Status 404 returned error can't find the container with id 4489d5a0d4611c005f5f312dbc34534c0e6fbd685f5de34a19605e7fc8115b85 Jun 02 02:49:37.202539 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:37.202502 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-69mdd" event={"ID":"51ff4c93-dadf-4a56-9e65-645b1123c885","Type":"ContainerStarted","Data":"4489d5a0d4611c005f5f312dbc34534c0e6fbd685f5de34a19605e7fc8115b85"} Jun 02 02:49:38.206305 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:38.206259 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-69mdd" event={"ID":"51ff4c93-dadf-4a56-9e65-645b1123c885","Type":"ContainerStarted","Data":"aa32a7c1470effd2a462a253defaba0362a52d2d8eefb2f06eea2a2450b35546"} Jun 02 02:49:38.206305 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:38.206303 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-69mdd" event={"ID":"51ff4c93-dadf-4a56-9e65-645b1123c885","Type":"ContainerStarted","Data":"a471e2163646a7f58984cb05b6c3e0b4176829a937b06f3de8d65d150f6a57d1"} Jun 02 02:49:38.224725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:38.224682 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-69mdd" podStartSLOduration=253.322808871 podStartE2EDuration="4m14.224668152s" podCreationTimestamp="2026-06-02 02:45:24 +0000 UTC" firstStartedPulling="2026-06-02 02:49:36.375141179 +0000 UTC m=+252.467675475" lastFinishedPulling="2026-06-02 02:49:37.277000457 +0000 UTC m=+253.369534756" observedRunningTime="2026-06-02 02:49:38.223910519 +0000 UTC m=+254.316444863" watchObservedRunningTime="2026-06-02 02:49:38.224668152 +0000 UTC m=+254.317202469" Jun 02 02:49:47.678590 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.678553 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-796c74c885-bvhlm"] Jun 02 02:49:47.678987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.678819 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11399bf2-2658-4ccf-ab67-67ca1a62fd6d" containerName="console" Jun 02 02:49:47.678987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.678829 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="11399bf2-2658-4ccf-ab67-67ca1a62fd6d" containerName="console" Jun 02 02:49:47.678987 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.678892 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="11399bf2-2658-4ccf-ab67-67ca1a62fd6d" containerName="console" Jun 02 02:49:47.681959 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.681934 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.711410 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.711384 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796c74c885-bvhlm"] Jun 02 02:49:47.758834 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.758811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-trusted-ca-bundle\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.758962 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.758843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d559\" (UniqueName: \"kubernetes.io/projected/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-kube-api-access-8d559\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.758962 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.758924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-service-ca\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.758962 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.758953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-config\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.759065 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.758970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-oauth-serving-cert\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.759065 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.759001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-serving-cert\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.759065 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.759023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-oauth-config\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.859513 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.859481 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-trusted-ca-bundle\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.859663 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.859519 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8d559\" (UniqueName: \"kubernetes.io/projected/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-kube-api-access-8d559\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.859785 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.859762 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-service-ca\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.859852 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.859811 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-config\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.859945 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.859917 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-oauth-serving-cert\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.860001 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.859952 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-serving-cert\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.860001 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.859972 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-oauth-config\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.860459 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.860428 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-trusted-ca-bundle\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.860564 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.860510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-config\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.860564 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.860528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-service-ca\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.860653 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.860640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-oauth-serving-cert\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.862330 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.862304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-serving-cert\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.862425 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.862372 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-oauth-config\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.868377 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.868346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d559\" (UniqueName: \"kubernetes.io/projected/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-kube-api-access-8d559\") pod \"console-796c74c885-bvhlm\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:47.990550 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:47.990525 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:48.129787 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:48.129633 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796c74c885-bvhlm"] Jun 02 02:49:48.131851 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:49:48.131811 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4e097f_ae1b_47cd_8e0b_e6c514bbd6fa.slice/crio-3724931c5673e787098e098fb308b460a9c4789bf7559a5307f5d94345d5b751 WatchSource:0}: Error finding container 3724931c5673e787098e098fb308b460a9c4789bf7559a5307f5d94345d5b751: Status 404 returned error can't find the container with id 3724931c5673e787098e098fb308b460a9c4789bf7559a5307f5d94345d5b751 Jun 02 02:49:48.235160 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:48.235124 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796c74c885-bvhlm" event={"ID":"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa","Type":"ContainerStarted","Data":"26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c"} Jun 02 02:49:48.235293 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:48.235169 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796c74c885-bvhlm" event={"ID":"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa","Type":"ContainerStarted","Data":"3724931c5673e787098e098fb308b460a9c4789bf7559a5307f5d94345d5b751"} Jun 02 02:49:48.254326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:48.254235 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-796c74c885-bvhlm" podStartSLOduration=1.2542190309999999 podStartE2EDuration="1.254219031s" podCreationTimestamp="2026-06-02 02:49:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:49:48.254065219 +0000 UTC m=+264.346599541" watchObservedRunningTime="2026-06-02 02:49:48.254219031 +0000 UTC m=+264.346753352" Jun 02 02:49:57.991354 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:57.991322 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:57.991761 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:57.991463 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:57.996240 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:57.996214 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:58.270156 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:58.270082 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:49:58.316995 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:49:58.316957 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dbb7f6dc-dz78k"] Jun 02 02:50:23.341587 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.341534 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-78dbb7f6dc-dz78k" podUID="634c1039-1c24-4532-aa1d-5a125c6e2df8" containerName="console" containerID="cri-o://96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3" gracePeriod=15 Jun 02 02:50:23.579201 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.579175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78dbb7f6dc-dz78k_634c1039-1c24-4532-aa1d-5a125c6e2df8/console/0.log" Jun 02 02:50:23.579309 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.579234 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:50:23.647166 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647098 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-service-ca\") pod \"634c1039-1c24-4532-aa1d-5a125c6e2df8\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " Jun 02 02:50:23.647166 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647148 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-serving-cert\") pod \"634c1039-1c24-4532-aa1d-5a125c6e2df8\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " Jun 02 02:50:23.647329 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647273 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-oauth-config\") pod \"634c1039-1c24-4532-aa1d-5a125c6e2df8\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " Jun 02 02:50:23.647329 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647300 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-config\") pod \"634c1039-1c24-4532-aa1d-5a125c6e2df8\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " Jun 02 02:50:23.647406 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647366 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql5ff\" (UniqueName: \"kubernetes.io/projected/634c1039-1c24-4532-aa1d-5a125c6e2df8-kube-api-access-ql5ff\") pod \"634c1039-1c24-4532-aa1d-5a125c6e2df8\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " Jun 02 02:50:23.647406 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647389 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-trusted-ca-bundle\") pod \"634c1039-1c24-4532-aa1d-5a125c6e2df8\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " Jun 02 02:50:23.647504 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647424 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-oauth-serving-cert\") pod \"634c1039-1c24-4532-aa1d-5a125c6e2df8\" (UID: \"634c1039-1c24-4532-aa1d-5a125c6e2df8\") " Jun 02 02:50:23.647504 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647443 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-service-ca" (OuterVolumeSpecName: "service-ca") pod "634c1039-1c24-4532-aa1d-5a125c6e2df8" (UID: "634c1039-1c24-4532-aa1d-5a125c6e2df8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:50:23.647673 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647657 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-service-ca\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:50:23.647807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647783 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-config" (OuterVolumeSpecName: "console-config") pod "634c1039-1c24-4532-aa1d-5a125c6e2df8" (UID: "634c1039-1c24-4532-aa1d-5a125c6e2df8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:50:23.647891 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647840 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "634c1039-1c24-4532-aa1d-5a125c6e2df8" (UID: "634c1039-1c24-4532-aa1d-5a125c6e2df8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:50:23.647938 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.647917 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "634c1039-1c24-4532-aa1d-5a125c6e2df8" (UID: "634c1039-1c24-4532-aa1d-5a125c6e2df8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:50:23.649410 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.649386 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "634c1039-1c24-4532-aa1d-5a125c6e2df8" (UID: "634c1039-1c24-4532-aa1d-5a125c6e2df8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:50:23.649616 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.649600 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634c1039-1c24-4532-aa1d-5a125c6e2df8-kube-api-access-ql5ff" (OuterVolumeSpecName: "kube-api-access-ql5ff") pod "634c1039-1c24-4532-aa1d-5a125c6e2df8" (UID: "634c1039-1c24-4532-aa1d-5a125c6e2df8"). InnerVolumeSpecName "kube-api-access-ql5ff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:50:23.649668 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.649652 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "634c1039-1c24-4532-aa1d-5a125c6e2df8" (UID: "634c1039-1c24-4532-aa1d-5a125c6e2df8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:50:23.748413 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.748383 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-serving-cert\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:50:23.748413 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.748409 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-oauth-config\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:50:23.748413 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.748418 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-console-config\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:50:23.748616 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.748427 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql5ff\" (UniqueName: \"kubernetes.io/projected/634c1039-1c24-4532-aa1d-5a125c6e2df8-kube-api-access-ql5ff\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:50:23.748616 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.748436 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-trusted-ca-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:50:23.748616 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:23.748445 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/634c1039-1c24-4532-aa1d-5a125c6e2df8-oauth-serving-cert\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:50:24.342260 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.342234 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78dbb7f6dc-dz78k_634c1039-1c24-4532-aa1d-5a125c6e2df8/console/0.log" Jun 02 02:50:24.342623 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.342271 2577 generic.go:358] "Generic (PLEG): container finished" podID="634c1039-1c24-4532-aa1d-5a125c6e2df8" containerID="96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3" exitCode=2 Jun 02 02:50:24.342623 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.342323 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dbb7f6dc-dz78k" event={"ID":"634c1039-1c24-4532-aa1d-5a125c6e2df8","Type":"ContainerDied","Data":"96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3"} Jun 02 02:50:24.342623 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.342334 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78dbb7f6dc-dz78k" Jun 02 02:50:24.342623 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.342343 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78dbb7f6dc-dz78k" event={"ID":"634c1039-1c24-4532-aa1d-5a125c6e2df8","Type":"ContainerDied","Data":"8fbb8ebeb92d10db9bf5ac969245107e691e5174661ecf49839343f5b5578ee4"} Jun 02 02:50:24.342623 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.342362 2577 scope.go:117] "RemoveContainer" containerID="96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3" Jun 02 02:50:24.350590 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.350575 2577 scope.go:117] "RemoveContainer" containerID="96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3" Jun 02 02:50:24.350837 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:50:24.350819 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3\": container with ID starting with 96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3 not found: ID does not exist" containerID="96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3" Jun 02 02:50:24.350917 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.350843 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3"} err="failed to get container status \"96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3\": rpc error: code = NotFound desc = could not find container \"96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3\": container with ID starting with 96dafea65e956ae7eefd38fb1cdda71e88a63d7e254657447c904d7135ace0a3 not found: ID does not exist" Jun 02 02:50:24.363627 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.363585 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78dbb7f6dc-dz78k"] Jun 02 02:50:24.363891 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.363855 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:50:24.364147 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.364130 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:50:24.369934 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.369905 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78dbb7f6dc-dz78k"] Jun 02 02:50:24.377076 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.377060 2577 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 02:50:24.444755 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:24.444616 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="634c1039-1c24-4532-aa1d-5a125c6e2df8" path="/var/lib/kubelet/pods/634c1039-1c24-4532-aa1d-5a125c6e2df8/volumes" Jun 02 02:50:41.850403 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.850368 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6g89r"] Jun 02 02:50:41.850798 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.850631 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="634c1039-1c24-4532-aa1d-5a125c6e2df8" containerName="console" Jun 02 02:50:41.850798 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.850641 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="634c1039-1c24-4532-aa1d-5a125c6e2df8" containerName="console" Jun 02 02:50:41.850798 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.850692 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="634c1039-1c24-4532-aa1d-5a125c6e2df8" containerName="console" Jun 02 02:50:41.852766 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.852750 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:41.855387 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.855368 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 02:50:41.863248 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.863223 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6g89r"] Jun 02 02:50:41.987063 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.987038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-dbus\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:41.987176 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.987068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-kubelet-config\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:41.987222 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:41.987202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-original-pull-secret\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.088371 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.088323 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-dbus\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.088371 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.088374 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-kubelet-config\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.088556 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.088443 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-original-pull-secret\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.088556 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.088520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-kubelet-config\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.088556 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.088523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-dbus\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.090649 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.090633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56f7dc6b-9956-4978-9bc2-661d9e8e87a8-original-pull-secret\") pod \"global-pull-secret-syncer-6g89r\" (UID: \"56f7dc6b-9956-4978-9bc2-661d9e8e87a8\") " pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.161447 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.161379 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g89r" Jun 02 02:50:42.284335 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.284299 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6g89r"] Jun 02 02:50:42.287101 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:50:42.287061 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f7dc6b_9956_4978_9bc2_661d9e8e87a8.slice/crio-7f77923f396d70870f617f4e527f1bdb954c0c60457cc556bfcb3d88ae578af3 WatchSource:0}: Error finding container 7f77923f396d70870f617f4e527f1bdb954c0c60457cc556bfcb3d88ae578af3: Status 404 returned error can't find the container with id 7f77923f396d70870f617f4e527f1bdb954c0c60457cc556bfcb3d88ae578af3 Jun 02 02:50:42.288600 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.288586 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:50:42.389879 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:42.389834 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6g89r" event={"ID":"56f7dc6b-9956-4978-9bc2-661d9e8e87a8","Type":"ContainerStarted","Data":"7f77923f396d70870f617f4e527f1bdb954c0c60457cc556bfcb3d88ae578af3"} Jun 02 02:50:47.406569 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:47.406533 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6g89r" event={"ID":"56f7dc6b-9956-4978-9bc2-661d9e8e87a8","Type":"ContainerStarted","Data":"302276825d1f4c9cb6670caffbc70b83ab405450a247bfb27823f8c1b1ea1701"} Jun 02 02:50:47.424873 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:50:47.424814 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6g89r" podStartSLOduration=2.019322963 podStartE2EDuration="6.424801803s" podCreationTimestamp="2026-06-02 02:50:41 +0000 UTC" firstStartedPulling="2026-06-02 02:50:42.288703894 +0000 UTC m=+318.381238190" lastFinishedPulling="2026-06-02 02:50:46.694182731 +0000 UTC m=+322.786717030" observedRunningTime="2026-06-02 02:50:47.424215382 +0000 UTC m=+323.516749705" watchObservedRunningTime="2026-06-02 02:50:47.424801803 +0000 UTC m=+323.517336162" Jun 02 02:51:13.366333 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.366256 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh"] Jun 02 02:51:13.368564 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.368545 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.371372 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.371339 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:51:13.371470 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.371403 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:51:13.372298 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.372283 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rr7ds\"" Jun 02 02:51:13.379071 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.379050 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh"] Jun 02 02:51:13.439048 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.439022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qglfm\" (UniqueName: \"kubernetes.io/projected/3480b4a7-d85e-4f62-97c5-f009ba3aee05-kube-api-access-qglfm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.439191 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.439083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.439191 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.439136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.539516 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.539486 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.539516 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.539518 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.539716 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.539549 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qglfm\" (UniqueName: \"kubernetes.io/projected/3480b4a7-d85e-4f62-97c5-f009ba3aee05-kube-api-access-qglfm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.539837 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.539813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.539933 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.539900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.547467 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.547449 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qglfm\" (UniqueName: \"kubernetes.io/projected/3480b4a7-d85e-4f62-97c5-f009ba3aee05-kube-api-access-qglfm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.678400 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.678317 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:13.800173 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:13.800139 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh"] Jun 02 02:51:13.803022 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:51:13.802989 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3480b4a7_d85e_4f62_97c5_f009ba3aee05.slice/crio-73d914c3a466165892b6746e40f9abbe20024c2002e3e801abd64aa8d196626d WatchSource:0}: Error finding container 73d914c3a466165892b6746e40f9abbe20024c2002e3e801abd64aa8d196626d: Status 404 returned error can't find the container with id 73d914c3a466165892b6746e40f9abbe20024c2002e3e801abd64aa8d196626d Jun 02 02:51:14.478382 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:14.478342 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" event={"ID":"3480b4a7-d85e-4f62-97c5-f009ba3aee05","Type":"ContainerStarted","Data":"73d914c3a466165892b6746e40f9abbe20024c2002e3e801abd64aa8d196626d"} Jun 02 02:51:21.499434 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:21.499392 2577 generic.go:358] "Generic (PLEG): container finished" podID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerID="8685d7f36f45e38ed3a39092b67e512e99957ec4bc20abe94e7b90734bb62e01" exitCode=0 Jun 02 02:51:21.499789 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:21.499482 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" event={"ID":"3480b4a7-d85e-4f62-97c5-f009ba3aee05","Type":"ContainerDied","Data":"8685d7f36f45e38ed3a39092b67e512e99957ec4bc20abe94e7b90734bb62e01"} Jun 02 02:51:24.509085 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:24.509052 2577 generic.go:358] "Generic (PLEG): container finished" podID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerID="c00845bee99100351f7e901eacbd8bf7b39dfe85ff39e34263c691ca0f17762c" exitCode=0 Jun 02 02:51:24.509396 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:24.509118 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" event={"ID":"3480b4a7-d85e-4f62-97c5-f009ba3aee05","Type":"ContainerDied","Data":"c00845bee99100351f7e901eacbd8bf7b39dfe85ff39e34263c691ca0f17762c"} Jun 02 02:51:32.537403 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:32.537369 2577 generic.go:358] "Generic (PLEG): container finished" podID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerID="cd124c19ca00d1ea7e50373c264f7e265f116722ec024373f62a27857eaed948" exitCode=0 Jun 02 02:51:32.537720 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:32.537430 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" event={"ID":"3480b4a7-d85e-4f62-97c5-f009ba3aee05","Type":"ContainerDied","Data":"cd124c19ca00d1ea7e50373c264f7e265f116722ec024373f62a27857eaed948"} Jun 02 02:51:33.658748 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.658726 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:33.809774 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.809693 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qglfm\" (UniqueName: \"kubernetes.io/projected/3480b4a7-d85e-4f62-97c5-f009ba3aee05-kube-api-access-qglfm\") pod \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " Jun 02 02:51:33.809774 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.809732 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-util\") pod \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " Jun 02 02:51:33.810021 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.809908 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-bundle\") pod \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\" (UID: \"3480b4a7-d85e-4f62-97c5-f009ba3aee05\") " Jun 02 02:51:33.810493 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.810466 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-bundle" (OuterVolumeSpecName: "bundle") pod "3480b4a7-d85e-4f62-97c5-f009ba3aee05" (UID: "3480b4a7-d85e-4f62-97c5-f009ba3aee05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:51:33.811932 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.811909 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3480b4a7-d85e-4f62-97c5-f009ba3aee05-kube-api-access-qglfm" (OuterVolumeSpecName: "kube-api-access-qglfm") pod "3480b4a7-d85e-4f62-97c5-f009ba3aee05" (UID: "3480b4a7-d85e-4f62-97c5-f009ba3aee05"). InnerVolumeSpecName "kube-api-access-qglfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:51:33.814135 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.814115 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-util" (OuterVolumeSpecName: "util") pod "3480b4a7-d85e-4f62-97c5-f009ba3aee05" (UID: "3480b4a7-d85e-4f62-97c5-f009ba3aee05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:51:33.910887 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.910852 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:51:33.910887 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.910889 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qglfm\" (UniqueName: \"kubernetes.io/projected/3480b4a7-d85e-4f62-97c5-f009ba3aee05-kube-api-access-qglfm\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:51:33.911014 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:33.910900 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3480b4a7-d85e-4f62-97c5-f009ba3aee05-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:51:34.544155 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:34.544121 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" event={"ID":"3480b4a7-d85e-4f62-97c5-f009ba3aee05","Type":"ContainerDied","Data":"73d914c3a466165892b6746e40f9abbe20024c2002e3e801abd64aa8d196626d"} Jun 02 02:51:34.544302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:34.544160 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73d914c3a466165892b6746e40f9abbe20024c2002e3e801abd64aa8d196626d" Jun 02 02:51:34.544302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:34.544164 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvnwzh" Jun 02 02:51:41.413364 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413323 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44"] Jun 02 02:51:41.413725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413614 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerName="pull" Jun 02 02:51:41.413725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413625 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerName="pull" Jun 02 02:51:41.413725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413632 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerName="util" Jun 02 02:51:41.413725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413638 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerName="util" Jun 02 02:51:41.413725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413652 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerName="extract" Jun 02 02:51:41.413725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413657 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerName="extract" Jun 02 02:51:41.413725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.413707 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="3480b4a7-d85e-4f62-97c5-f009ba3aee05" containerName="extract" Jun 02 02:51:41.417619 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.417601 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.420242 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.420219 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:51:41.420371 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.420254 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 02:51:41.420371 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.420221 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6d5dx\"" Jun 02 02:51:41.435709 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.435689 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44"] Jun 02 02:51:41.575047 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.575011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ffb855-1dba-46d5-a295-e119dc1b5093-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ssn44\" (UID: \"11ffb855-1dba-46d5-a295-e119dc1b5093\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.575191 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.575062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p88pl\" (UniqueName: \"kubernetes.io/projected/11ffb855-1dba-46d5-a295-e119dc1b5093-kube-api-access-p88pl\") pod \"cert-manager-operator-controller-manager-54b9655956-ssn44\" (UID: \"11ffb855-1dba-46d5-a295-e119dc1b5093\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.676587 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.676500 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ffb855-1dba-46d5-a295-e119dc1b5093-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ssn44\" (UID: \"11ffb855-1dba-46d5-a295-e119dc1b5093\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.676587 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.676557 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p88pl\" (UniqueName: \"kubernetes.io/projected/11ffb855-1dba-46d5-a295-e119dc1b5093-kube-api-access-p88pl\") pod \"cert-manager-operator-controller-manager-54b9655956-ssn44\" (UID: \"11ffb855-1dba-46d5-a295-e119dc1b5093\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.676847 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.676823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ffb855-1dba-46d5-a295-e119dc1b5093-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ssn44\" (UID: \"11ffb855-1dba-46d5-a295-e119dc1b5093\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.684701 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.684679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p88pl\" (UniqueName: \"kubernetes.io/projected/11ffb855-1dba-46d5-a295-e119dc1b5093-kube-api-access-p88pl\") pod \"cert-manager-operator-controller-manager-54b9655956-ssn44\" (UID: \"11ffb855-1dba-46d5-a295-e119dc1b5093\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.726241 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.726219 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" Jun 02 02:51:41.852543 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:41.852516 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44"] Jun 02 02:51:41.854829 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:51:41.854803 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ffb855_1dba_46d5_a295_e119dc1b5093.slice/crio-644c148aaaae6158234743229127f98bd453be3ac53815e3ce9bb0100414cb27 WatchSource:0}: Error finding container 644c148aaaae6158234743229127f98bd453be3ac53815e3ce9bb0100414cb27: Status 404 returned error can't find the container with id 644c148aaaae6158234743229127f98bd453be3ac53815e3ce9bb0100414cb27 Jun 02 02:51:42.567047 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:42.567010 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" event={"ID":"11ffb855-1dba-46d5-a295-e119dc1b5093","Type":"ContainerStarted","Data":"644c148aaaae6158234743229127f98bd453be3ac53815e3ce9bb0100414cb27"} Jun 02 02:51:43.571889 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:43.571781 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" event={"ID":"11ffb855-1dba-46d5-a295-e119dc1b5093","Type":"ContainerStarted","Data":"bcbc9b3d924f7c6642f1c0d537e26f6b1ec9d06602723fa68f86b5fbeb00b8d6"} Jun 02 02:51:43.597174 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:43.597120 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ssn44" podStartSLOduration=1.178016847 podStartE2EDuration="2.597103996s" podCreationTimestamp="2026-06-02 02:51:41 +0000 UTC" firstStartedPulling="2026-06-02 02:51:41.857380189 +0000 UTC m=+377.949914499" lastFinishedPulling="2026-06-02 02:51:43.276467351 +0000 UTC m=+379.369001648" observedRunningTime="2026-06-02 02:51:43.595101685 +0000 UTC m=+379.687636005" watchObservedRunningTime="2026-06-02 02:51:43.597103996 +0000 UTC m=+379.689638315" Jun 02 02:51:44.859256 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:44.859224 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm"] Jun 02 02:51:44.862634 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:44.862619 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:44.865181 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:44.865149 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:51:44.865306 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:44.865196 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rr7ds\"" Jun 02 02:51:44.865306 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:44.865232 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:51:44.872013 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:44.871993 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm"] Jun 02 02:51:45.001708 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.001674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.001891 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.001718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knxw8\" (UniqueName: \"kubernetes.io/projected/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-kube-api-access-knxw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.001891 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.001750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.102433 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.102406 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knxw8\" (UniqueName: \"kubernetes.io/projected/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-kube-api-access-knxw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.102578 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.102452 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.102578 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.102498 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.102807 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.102789 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.102913 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.102852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.110725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.110669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knxw8\" (UniqueName: \"kubernetes.io/projected/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-kube-api-access-knxw8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.172695 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.172658 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:45.327216 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.327194 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm"] Jun 02 02:51:45.329773 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:51:45.329740 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f65b0b4_3e8d_4cd5_a87a_54a4e9f256b1.slice/crio-a9096984bd657fdbe93c517596ee3034243b70cc4af222cece5b2c3b13f9538c WatchSource:0}: Error finding container a9096984bd657fdbe93c517596ee3034243b70cc4af222cece5b2c3b13f9538c: Status 404 returned error can't find the container with id a9096984bd657fdbe93c517596ee3034243b70cc4af222cece5b2c3b13f9538c Jun 02 02:51:45.578518 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.578482 2577 generic.go:358] "Generic (PLEG): container finished" podID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerID="db716f772e5f4eb0a108e9bb68911c21a4513c919fc35dbc1cbf9451406c7f90" exitCode=0 Jun 02 02:51:45.578680 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.578548 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" event={"ID":"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1","Type":"ContainerDied","Data":"db716f772e5f4eb0a108e9bb68911c21a4513c919fc35dbc1cbf9451406c7f90"} Jun 02 02:51:45.578680 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:45.578578 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" event={"ID":"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1","Type":"ContainerStarted","Data":"a9096984bd657fdbe93c517596ee3034243b70cc4af222cece5b2c3b13f9538c"} Jun 02 02:51:48.588761 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:48.588729 2577 generic.go:358] "Generic (PLEG): container finished" podID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerID="0abc01efdfbe258d0660a4a7f64e4e6fc8c431d420df633b0e3875497ad1a942" exitCode=0 Jun 02 02:51:48.589152 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:48.588766 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" event={"ID":"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1","Type":"ContainerDied","Data":"0abc01efdfbe258d0660a4a7f64e4e6fc8c431d420df633b0e3875497ad1a942"} Jun 02 02:51:49.593959 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:49.593918 2577 generic.go:358] "Generic (PLEG): container finished" podID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerID="19e8ac9fa8944817d235fbba0d8a0c551f67cc8a3ebedc3eeb70dd36574f3ab2" exitCode=0 Jun 02 02:51:49.594320 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:49.594014 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" event={"ID":"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1","Type":"ContainerDied","Data":"19e8ac9fa8944817d235fbba0d8a0c551f67cc8a3ebedc3eeb70dd36574f3ab2"} Jun 02 02:51:50.720937 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.720914 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:50.746243 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.746216 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knxw8\" (UniqueName: \"kubernetes.io/projected/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-kube-api-access-knxw8\") pod \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " Jun 02 02:51:50.746363 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.746290 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-util\") pod \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " Jun 02 02:51:50.746363 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.746329 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-bundle\") pod \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\" (UID: \"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1\") " Jun 02 02:51:50.746695 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.746673 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-bundle" (OuterVolumeSpecName: "bundle") pod "4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" (UID: "4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:51:50.748267 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.748241 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-kube-api-access-knxw8" (OuterVolumeSpecName: "kube-api-access-knxw8") pod "4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" (UID: "4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1"). InnerVolumeSpecName "kube-api-access-knxw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:51:50.831789 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.831751 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-util" (OuterVolumeSpecName: "util") pod "4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" (UID: "4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:51:50.847830 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.847771 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knxw8\" (UniqueName: \"kubernetes.io/projected/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-kube-api-access-knxw8\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:51:50.847830 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.847791 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:51:50.847830 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:50.847801 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:51:51.601748 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.601711 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" event={"ID":"4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1","Type":"ContainerDied","Data":"a9096984bd657fdbe93c517596ee3034243b70cc4af222cece5b2c3b13f9538c"} Jun 02 02:51:51.601748 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.601749 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9096984bd657fdbe93c517596ee3034243b70cc4af222cece5b2c3b13f9538c" Jun 02 02:51:51.601969 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.601774 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsncpm" Jun 02 02:51:51.651949 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.651913 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-z8kgq"] Jun 02 02:51:51.652286 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.652270 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerName="pull" Jun 02 02:51:51.652360 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.652289 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerName="pull" Jun 02 02:51:51.652360 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.652313 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerName="extract" Jun 02 02:51:51.652360 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.652322 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerName="extract" Jun 02 02:51:51.652360 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.652336 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerName="util" Jun 02 02:51:51.652360 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.652345 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerName="util" Jun 02 02:51:51.652582 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.652418 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f65b0b4-3e8d-4cd5-a87a-54a4e9f256b1" containerName="extract" Jun 02 02:51:51.654684 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.654664 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:51.657215 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.657195 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zdddc\"" Jun 02 02:51:51.657311 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.657222 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 02:51:51.657311 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.657222 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 02:51:51.661813 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.661793 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-z8kgq"] Jun 02 02:51:51.754328 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.754291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwl6p\" (UniqueName: \"kubernetes.io/projected/86edcfb2-0662-48a2-bbf1-47743971c762-kube-api-access-cwl6p\") pod \"cert-manager-webhook-587ccfb98-z8kgq\" (UID: \"86edcfb2-0662-48a2-bbf1-47743971c762\") " pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:51.754634 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.754336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86edcfb2-0662-48a2-bbf1-47743971c762-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-z8kgq\" (UID: \"86edcfb2-0662-48a2-bbf1-47743971c762\") " pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:51.855570 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.855508 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwl6p\" (UniqueName: \"kubernetes.io/projected/86edcfb2-0662-48a2-bbf1-47743971c762-kube-api-access-cwl6p\") pod \"cert-manager-webhook-587ccfb98-z8kgq\" (UID: \"86edcfb2-0662-48a2-bbf1-47743971c762\") " pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:51.855570 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.855541 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86edcfb2-0662-48a2-bbf1-47743971c762-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-z8kgq\" (UID: \"86edcfb2-0662-48a2-bbf1-47743971c762\") " pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:51.864548 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.864525 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86edcfb2-0662-48a2-bbf1-47743971c762-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-z8kgq\" (UID: \"86edcfb2-0662-48a2-bbf1-47743971c762\") " pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:51.864746 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.864726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwl6p\" (UniqueName: \"kubernetes.io/projected/86edcfb2-0662-48a2-bbf1-47743971c762-kube-api-access-cwl6p\") pod \"cert-manager-webhook-587ccfb98-z8kgq\" (UID: \"86edcfb2-0662-48a2-bbf1-47743971c762\") " pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:51.973521 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:51.973481 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:52.095686 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:52.095653 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-z8kgq"] Jun 02 02:51:52.098693 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:51:52.098659 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86edcfb2_0662_48a2_bbf1_47743971c762.slice/crio-eca75c1a2a037617c04b51e1d7bc58f01ca0f5c00eb4f2f61c1a4de1a0c715ce WatchSource:0}: Error finding container eca75c1a2a037617c04b51e1d7bc58f01ca0f5c00eb4f2f61c1a4de1a0c715ce: Status 404 returned error can't find the container with id eca75c1a2a037617c04b51e1d7bc58f01ca0f5c00eb4f2f61c1a4de1a0c715ce Jun 02 02:51:52.605710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:52.605675 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" event={"ID":"86edcfb2-0662-48a2-bbf1-47743971c762","Type":"ContainerStarted","Data":"eca75c1a2a037617c04b51e1d7bc58f01ca0f5c00eb4f2f61c1a4de1a0c715ce"} Jun 02 02:51:55.616319 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:55.616285 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" event={"ID":"86edcfb2-0662-48a2-bbf1-47743971c762","Type":"ContainerStarted","Data":"4054c847f89d1f3d487ef3feb303eb7c095bf72b46b7f26c06a34a33bffa5842"} Jun 02 02:51:55.616693 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:55.616411 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:51:55.632826 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:51:55.632763 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" podStartSLOduration=1.819841901 podStartE2EDuration="4.632743342s" podCreationTimestamp="2026-06-02 02:51:51 +0000 UTC" firstStartedPulling="2026-06-02 02:51:52.100586378 +0000 UTC m=+388.193120675" lastFinishedPulling="2026-06-02 02:51:54.913487801 +0000 UTC m=+391.006022116" observedRunningTime="2026-06-02 02:51:55.631583658 +0000 UTC m=+391.724117976" watchObservedRunningTime="2026-06-02 02:51:55.632743342 +0000 UTC m=+391.725277661" Jun 02 02:52:01.622291 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:01.622200 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-z8kgq" Jun 02 02:52:04.593138 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.593106 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-4sw5x"] Jun 02 02:52:04.612259 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.612235 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-4sw5x"] Jun 02 02:52:04.612413 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.612330 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.615011 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.614985 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-56ptd\"" Jun 02 02:52:04.663371 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.663342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8fae79f-050c-4875-82a5-b10b92db976e-bound-sa-token\") pod \"cert-manager-79c8d999ff-4sw5x\" (UID: \"d8fae79f-050c-4875-82a5-b10b92db976e\") " pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.663522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.663399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhlz\" (UniqueName: \"kubernetes.io/projected/d8fae79f-050c-4875-82a5-b10b92db976e-kube-api-access-2zhlz\") pod \"cert-manager-79c8d999ff-4sw5x\" (UID: \"d8fae79f-050c-4875-82a5-b10b92db976e\") " pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.764326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.764295 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8fae79f-050c-4875-82a5-b10b92db976e-bound-sa-token\") pod \"cert-manager-79c8d999ff-4sw5x\" (UID: \"d8fae79f-050c-4875-82a5-b10b92db976e\") " pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.764465 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.764360 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhlz\" (UniqueName: \"kubernetes.io/projected/d8fae79f-050c-4875-82a5-b10b92db976e-kube-api-access-2zhlz\") pod \"cert-manager-79c8d999ff-4sw5x\" (UID: \"d8fae79f-050c-4875-82a5-b10b92db976e\") " pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.772299 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.772271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8fae79f-050c-4875-82a5-b10b92db976e-bound-sa-token\") pod \"cert-manager-79c8d999ff-4sw5x\" (UID: \"d8fae79f-050c-4875-82a5-b10b92db976e\") " pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.772419 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.772402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhlz\" (UniqueName: \"kubernetes.io/projected/d8fae79f-050c-4875-82a5-b10b92db976e-kube-api-access-2zhlz\") pod \"cert-manager-79c8d999ff-4sw5x\" (UID: \"d8fae79f-050c-4875-82a5-b10b92db976e\") " pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.900124 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.900043 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx"] Jun 02 02:52:04.914384 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.914357 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx"] Jun 02 02:52:04.914509 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.914478 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:04.920607 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.920574 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rr7ds\"" Jun 02 02:52:04.920607 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.920589 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:52:04.920791 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.920659 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:52:04.920874 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.920836 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-4sw5x" Jun 02 02:52:04.966942 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.966910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:04.967081 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.967010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:04.967132 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:04.967081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx6xp\" (UniqueName: \"kubernetes.io/projected/7e8d60b5-c475-4c14-a611-ca8b26b61a28-kube-api-access-wx6xp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.068214 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.068173 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.068398 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.068246 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx6xp\" (UniqueName: \"kubernetes.io/projected/7e8d60b5-c475-4c14-a611-ca8b26b61a28-kube-api-access-wx6xp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.068398 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.068290 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.068560 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.068539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.068616 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.068580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.073014 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.072989 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-4sw5x"] Jun 02 02:52:05.075964 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:05.075936 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8fae79f_050c_4875_82a5_b10b92db976e.slice/crio-d998722322f2f6c9d29d4f3d75ed7217db54f1d10291f93c977d2a97dbaa0789 WatchSource:0}: Error finding container d998722322f2f6c9d29d4f3d75ed7217db54f1d10291f93c977d2a97dbaa0789: Status 404 returned error can't find the container with id d998722322f2f6c9d29d4f3d75ed7217db54f1d10291f93c977d2a97dbaa0789 Jun 02 02:52:05.079022 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.079002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx6xp\" (UniqueName: \"kubernetes.io/projected/7e8d60b5-c475-4c14-a611-ca8b26b61a28-kube-api-access-wx6xp\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.225145 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.225119 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:05.349587 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.349567 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx"] Jun 02 02:52:05.351713 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:05.351683 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8d60b5_c475_4c14_a611_ca8b26b61a28.slice/crio-8d0f7ab326c0ca0a00386de176c12268e5c7ae4585e16c42d3471c7a1759732c WatchSource:0}: Error finding container 8d0f7ab326c0ca0a00386de176c12268e5c7ae4585e16c42d3471c7a1759732c: Status 404 returned error can't find the container with id 8d0f7ab326c0ca0a00386de176c12268e5c7ae4585e16c42d3471c7a1759732c Jun 02 02:52:05.652293 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.652209 2577 generic.go:358] "Generic (PLEG): container finished" podID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerID="00dfcb28ee7e08407da755263a91161c6bd13a23df857e5648f937b888c49d55" exitCode=0 Jun 02 02:52:05.652698 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.652292 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" event={"ID":"7e8d60b5-c475-4c14-a611-ca8b26b61a28","Type":"ContainerDied","Data":"00dfcb28ee7e08407da755263a91161c6bd13a23df857e5648f937b888c49d55"} Jun 02 02:52:05.652698 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.652331 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" event={"ID":"7e8d60b5-c475-4c14-a611-ca8b26b61a28","Type":"ContainerStarted","Data":"8d0f7ab326c0ca0a00386de176c12268e5c7ae4585e16c42d3471c7a1759732c"} Jun 02 02:52:05.653677 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.653656 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-4sw5x" event={"ID":"d8fae79f-050c-4875-82a5-b10b92db976e","Type":"ContainerStarted","Data":"9fc38b9ecae1fedebb8231cc7e140dc635bd30687c8ab9a96bfcc43838793690"} Jun 02 02:52:05.653773 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.653681 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-4sw5x" event={"ID":"d8fae79f-050c-4875-82a5-b10b92db976e","Type":"ContainerStarted","Data":"d998722322f2f6c9d29d4f3d75ed7217db54f1d10291f93c977d2a97dbaa0789"} Jun 02 02:52:05.699643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:05.699604 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-4sw5x" podStartSLOduration=1.699581773 podStartE2EDuration="1.699581773s" podCreationTimestamp="2026-06-02 02:52:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:52:05.699114296 +0000 UTC m=+401.791648614" watchObservedRunningTime="2026-06-02 02:52:05.699581773 +0000 UTC m=+401.792116091" Jun 02 02:52:06.659136 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:06.659106 2577 generic.go:358] "Generic (PLEG): container finished" podID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerID="cfb5a9646dd405aafb087cdb35a9664dc29c6a9ffffaae760a847d34e31f9432" exitCode=0 Jun 02 02:52:06.659524 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:06.659196 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" event={"ID":"7e8d60b5-c475-4c14-a611-ca8b26b61a28","Type":"ContainerDied","Data":"cfb5a9646dd405aafb087cdb35a9664dc29c6a9ffffaae760a847d34e31f9432"} Jun 02 02:52:07.664093 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:07.664058 2577 generic.go:358] "Generic (PLEG): container finished" podID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerID="5c0dbc618d943868294b98d95c287ee0e11cc70faa932278f148803c940841b1" exitCode=0 Jun 02 02:52:07.664463 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:07.664154 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" event={"ID":"7e8d60b5-c475-4c14-a611-ca8b26b61a28","Type":"ContainerDied","Data":"5c0dbc618d943868294b98d95c287ee0e11cc70faa932278f148803c940841b1"} Jun 02 02:52:08.789685 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:08.789662 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:08.903035 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:08.903009 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx6xp\" (UniqueName: \"kubernetes.io/projected/7e8d60b5-c475-4c14-a611-ca8b26b61a28-kube-api-access-wx6xp\") pod \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " Jun 02 02:52:08.903172 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:08.903092 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-bundle\") pod \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " Jun 02 02:52:08.903172 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:08.903125 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-util\") pod \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\" (UID: \"7e8d60b5-c475-4c14-a611-ca8b26b61a28\") " Jun 02 02:52:08.903768 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:08.903738 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-bundle" (OuterVolumeSpecName: "bundle") pod "7e8d60b5-c475-4c14-a611-ca8b26b61a28" (UID: "7e8d60b5-c475-4c14-a611-ca8b26b61a28"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:52:08.905057 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:08.905036 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8d60b5-c475-4c14-a611-ca8b26b61a28-kube-api-access-wx6xp" (OuterVolumeSpecName: "kube-api-access-wx6xp") pod "7e8d60b5-c475-4c14-a611-ca8b26b61a28" (UID: "7e8d60b5-c475-4c14-a611-ca8b26b61a28"). InnerVolumeSpecName "kube-api-access-wx6xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:52:08.911025 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:08.910985 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-util" (OuterVolumeSpecName: "util") pod "7e8d60b5-c475-4c14-a611-ca8b26b61a28" (UID: "7e8d60b5-c475-4c14-a611-ca8b26b61a28"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:52:09.003592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:09.003565 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:09.003592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:09.003588 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8d60b5-c475-4c14-a611-ca8b26b61a28-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:09.003744 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:09.003597 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx6xp\" (UniqueName: \"kubernetes.io/projected/7e8d60b5-c475-4c14-a611-ca8b26b61a28-kube-api-access-wx6xp\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:09.672274 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:09.672249 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" Jun 02 02:52:09.672435 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:09.672248 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfp8xx" event={"ID":"7e8d60b5-c475-4c14-a611-ca8b26b61a28","Type":"ContainerDied","Data":"8d0f7ab326c0ca0a00386de176c12268e5c7ae4585e16c42d3471c7a1759732c"} Jun 02 02:52:09.672435 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:09.672348 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d0f7ab326c0ca0a00386de176c12268e5c7ae4585e16c42d3471c7a1759732c" Jun 02 02:52:17.461814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.461779 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z"] Jun 02 02:52:17.462227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.462078 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerName="extract" Jun 02 02:52:17.462227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.462089 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerName="extract" Jun 02 02:52:17.462227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.462099 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerName="util" Jun 02 02:52:17.462227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.462105 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerName="util" Jun 02 02:52:17.462227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.462123 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerName="pull" Jun 02 02:52:17.462227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.462129 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerName="pull" Jun 02 02:52:17.462227 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.462184 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e8d60b5-c475-4c14-a611-ca8b26b61a28" containerName="extract" Jun 02 02:52:17.465106 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.465085 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.467686 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.467665 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 02:52:17.468021 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.467999 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 02:52:17.468132 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.468043 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 02:52:17.468132 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.468046 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 02:52:17.468417 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.468404 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4m85r\"" Jun 02 02:52:17.484128 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.484104 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z"] Jun 02 02:52:17.577902 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.577845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/336c62ff-d6b1-42da-947e-5a4909d4d89f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.578103 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.577909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvjd\" (UniqueName: \"kubernetes.io/projected/336c62ff-d6b1-42da-947e-5a4909d4d89f-kube-api-access-gmvjd\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.578103 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.577964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/336c62ff-d6b1-42da-947e-5a4909d4d89f-manifests\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.578103 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.578040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/336c62ff-d6b1-42da-947e-5a4909d4d89f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.578103 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.578079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/336c62ff-d6b1-42da-947e-5a4909d4d89f-tmp\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.678957 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.678924 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/336c62ff-d6b1-42da-947e-5a4909d4d89f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.678957 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.678957 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvjd\" (UniqueName: \"kubernetes.io/projected/336c62ff-d6b1-42da-947e-5a4909d4d89f-kube-api-access-gmvjd\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.679151 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.678985 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/336c62ff-d6b1-42da-947e-5a4909d4d89f-manifests\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.679151 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.679026 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/336c62ff-d6b1-42da-947e-5a4909d4d89f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.679151 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.679061 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/336c62ff-d6b1-42da-947e-5a4909d4d89f-tmp\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.679444 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.679410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/336c62ff-d6b1-42da-947e-5a4909d4d89f-manifests\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.681346 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.681313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/336c62ff-d6b1-42da-947e-5a4909d4d89f-tmp\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.681496 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.681472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/336c62ff-d6b1-42da-947e-5a4909d4d89f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.681556 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.681467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/336c62ff-d6b1-42da-947e-5a4909d4d89f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.689947 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.689929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvjd\" (UniqueName: \"kubernetes.io/projected/336c62ff-d6b1-42da-947e-5a4909d4d89f-kube-api-access-gmvjd\") pod \"opendatahub-operator-controller-manager-f8cc9fd78-ltf8z\" (UID: \"336c62ff-d6b1-42da-947e-5a4909d4d89f\") " pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.775830 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.775747 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:17.915524 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:17.915490 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z"] Jun 02 02:52:17.917915 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:17.917888 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336c62ff_d6b1_42da_947e_5a4909d4d89f.slice/crio-cc4de91d5b1987e5891769f927cb0ee8a69f9feead2bb15bc3bdebfe9d1994e6 WatchSource:0}: Error finding container cc4de91d5b1987e5891769f927cb0ee8a69f9feead2bb15bc3bdebfe9d1994e6: Status 404 returned error can't find the container with id cc4de91d5b1987e5891769f927cb0ee8a69f9feead2bb15bc3bdebfe9d1994e6 Jun 02 02:52:18.703495 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:18.703441 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" event={"ID":"336c62ff-d6b1-42da-947e-5a4909d4d89f","Type":"ContainerStarted","Data":"cc4de91d5b1987e5891769f927cb0ee8a69f9feead2bb15bc3bdebfe9d1994e6"} Jun 02 02:52:20.711544 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:20.711514 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" event={"ID":"336c62ff-d6b1-42da-947e-5a4909d4d89f","Type":"ContainerStarted","Data":"91af749d69268fe81a7141c01b8e49701bbca44ce0e74742d891862581943805"} Jun 02 02:52:21.716073 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:21.716037 2577 generic.go:358] "Generic (PLEG): container finished" podID="336c62ff-d6b1-42da-947e-5a4909d4d89f" containerID="91af749d69268fe81a7141c01b8e49701bbca44ce0e74742d891862581943805" exitCode=0 Jun 02 02:52:21.716439 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:21.716117 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" event={"ID":"336c62ff-d6b1-42da-947e-5a4909d4d89f","Type":"ContainerDied","Data":"91af749d69268fe81a7141c01b8e49701bbca44ce0e74742d891862581943805"} Jun 02 02:52:22.722026 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:22.721981 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" event={"ID":"336c62ff-d6b1-42da-947e-5a4909d4d89f","Type":"ContainerStarted","Data":"68c3d291eb7a05e3cb28168b8b146d88f10bd9c58047e8764fd1641ca4ab2c88"} Jun 02 02:52:22.722466 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:22.722152 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:22.748890 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:22.748819 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" podStartSLOduration=1.652103276 podStartE2EDuration="5.748802083s" podCreationTimestamp="2026-06-02 02:52:17 +0000 UTC" firstStartedPulling="2026-06-02 02:52:17.919548584 +0000 UTC m=+414.012082880" lastFinishedPulling="2026-06-02 02:52:22.016247373 +0000 UTC m=+418.108781687" observedRunningTime="2026-06-02 02:52:22.745289391 +0000 UTC m=+418.837823710" watchObservedRunningTime="2026-06-02 02:52:22.748802083 +0000 UTC m=+418.841336405" Jun 02 02:52:33.727912 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:33.727810 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f8cc9fd78-ltf8z" Jun 02 02:52:36.199845 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.199806 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv"] Jun 02 02:52:36.203327 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.203307 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.205580 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.205550 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 02:52:36.205751 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.205733 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 02:52:36.205875 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.205834 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6g6sv\"" Jun 02 02:52:36.214389 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.214371 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv"] Jun 02 02:52:36.316430 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.316396 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn"] Jun 02 02:52:36.319704 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.319680 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.322633 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.322613 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:52:36.322768 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.322743 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rr7ds\"" Jun 02 02:52:36.322940 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.322923 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:52:36.336342 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.336322 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn"] Jun 02 02:52:36.339668 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.339642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f355e56-2783-44d0-81ab-e01aa33d6278-tls-certs\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.339756 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.339710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p4cc\" (UniqueName: \"kubernetes.io/projected/2f355e56-2783-44d0-81ab-e01aa33d6278-kube-api-access-2p4cc\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.339921 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.339900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f355e56-2783-44d0-81ab-e01aa33d6278-tmp\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.440315 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.440280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh7rw\" (UniqueName: \"kubernetes.io/projected/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-kube-api-access-rh7rw\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.440471 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.440322 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f355e56-2783-44d0-81ab-e01aa33d6278-tmp\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.440471 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.440412 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f355e56-2783-44d0-81ab-e01aa33d6278-tls-certs\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.440471 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.440445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.440652 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.440500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.440652 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.440524 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p4cc\" (UniqueName: \"kubernetes.io/projected/2f355e56-2783-44d0-81ab-e01aa33d6278-kube-api-access-2p4cc\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.440652 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:52:36.440551 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 02 02:52:36.440806 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:52:36.440704 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f355e56-2783-44d0-81ab-e01aa33d6278-tls-certs podName:2f355e56-2783-44d0-81ab-e01aa33d6278 nodeName:}" failed. No retries permitted until 2026-06-02 02:52:36.940681595 +0000 UTC m=+433.033215896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2f355e56-2783-44d0-81ab-e01aa33d6278-tls-certs") pod "kube-auth-proxy-85d86d5b57-zwwcv" (UID: "2f355e56-2783-44d0-81ab-e01aa33d6278") : secret "kube-auth-proxy-tls" not found Jun 02 02:52:36.443088 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.443063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f355e56-2783-44d0-81ab-e01aa33d6278-tmp\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.462916 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.462889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p4cc\" (UniqueName: \"kubernetes.io/projected/2f355e56-2783-44d0-81ab-e01aa33d6278-kube-api-access-2p4cc\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.542411 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.541666 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh7rw\" (UniqueName: \"kubernetes.io/projected/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-kube-api-access-rh7rw\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.542411 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.541754 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.542411 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.541818 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.542411 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.542200 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.542411 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.542219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.551184 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.551148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh7rw\" (UniqueName: \"kubernetes.io/projected/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-kube-api-access-rh7rw\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.628939 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.628905 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:36.772532 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.772497 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn"] Jun 02 02:52:36.775395 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:36.775361 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f04c179_36c3_47f1_9c57_ab7e569ed2aa.slice/crio-79c2847923d307382479f0c9dc4d639ed7c2b77deacfa7b147a5ff4e8bd51d43 WatchSource:0}: Error finding container 79c2847923d307382479f0c9dc4d639ed7c2b77deacfa7b147a5ff4e8bd51d43: Status 404 returned error can't find the container with id 79c2847923d307382479f0c9dc4d639ed7c2b77deacfa7b147a5ff4e8bd51d43 Jun 02 02:52:36.945725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.945682 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f355e56-2783-44d0-81ab-e01aa33d6278-tls-certs\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:36.948159 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:36.948125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f355e56-2783-44d0-81ab-e01aa33d6278-tls-certs\") pod \"kube-auth-proxy-85d86d5b57-zwwcv\" (UID: \"2f355e56-2783-44d0-81ab-e01aa33d6278\") " pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:37.058310 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.058229 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-6q8p2"] Jun 02 02:52:37.061722 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.061702 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.064372 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.064346 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 02:52:37.069905 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.069883 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-6q8p2"] Jun 02 02:52:37.115013 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.114991 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" Jun 02 02:52:37.248392 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.248363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h7mq\" (UniqueName: \"kubernetes.io/projected/c8eeddf4-e81a-4a11-9417-b381dba3d581-kube-api-access-2h7mq\") pod \"model-serving-api-6577596cd5-6q8p2\" (UID: \"c8eeddf4-e81a-4a11-9417-b381dba3d581\") " pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.248754 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.248407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8eeddf4-e81a-4a11-9417-b381dba3d581-tls-certs\") pod \"model-serving-api-6577596cd5-6q8p2\" (UID: \"c8eeddf4-e81a-4a11-9417-b381dba3d581\") " pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.253786 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.253764 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv"] Jun 02 02:52:37.256047 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:37.256021 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f355e56_2783_44d0_81ab_e01aa33d6278.slice/crio-a5ec061a7ad09efcc23dc3045a03c20bd6ae44705a7ae2683c0b6686a87aa7ac WatchSource:0}: Error finding container a5ec061a7ad09efcc23dc3045a03c20bd6ae44705a7ae2683c0b6686a87aa7ac: Status 404 returned error can't find the container with id a5ec061a7ad09efcc23dc3045a03c20bd6ae44705a7ae2683c0b6686a87aa7ac Jun 02 02:52:37.349743 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.349653 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h7mq\" (UniqueName: \"kubernetes.io/projected/c8eeddf4-e81a-4a11-9417-b381dba3d581-kube-api-access-2h7mq\") pod \"model-serving-api-6577596cd5-6q8p2\" (UID: \"c8eeddf4-e81a-4a11-9417-b381dba3d581\") " pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.349743 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.349700 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8eeddf4-e81a-4a11-9417-b381dba3d581-tls-certs\") pod \"model-serving-api-6577596cd5-6q8p2\" (UID: \"c8eeddf4-e81a-4a11-9417-b381dba3d581\") " pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.352134 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.352112 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8eeddf4-e81a-4a11-9417-b381dba3d581-tls-certs\") pod \"model-serving-api-6577596cd5-6q8p2\" (UID: \"c8eeddf4-e81a-4a11-9417-b381dba3d581\") " pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.360305 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.360283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h7mq\" (UniqueName: \"kubernetes.io/projected/c8eeddf4-e81a-4a11-9417-b381dba3d581-kube-api-access-2h7mq\") pod \"model-serving-api-6577596cd5-6q8p2\" (UID: \"c8eeddf4-e81a-4a11-9417-b381dba3d581\") " pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.372550 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.372533 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:37.527325 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.527295 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-6q8p2"] Jun 02 02:52:37.528678 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:37.528651 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8eeddf4_e81a_4a11_9417_b381dba3d581.slice/crio-93021d106ea730ed6b159e8f50ce826901d46106384f1cab23d94fb5a46b04e1 WatchSource:0}: Error finding container 93021d106ea730ed6b159e8f50ce826901d46106384f1cab23d94fb5a46b04e1: Status 404 returned error can't find the container with id 93021d106ea730ed6b159e8f50ce826901d46106384f1cab23d94fb5a46b04e1 Jun 02 02:52:37.775468 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.775433 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" event={"ID":"2f355e56-2783-44d0-81ab-e01aa33d6278","Type":"ContainerStarted","Data":"a5ec061a7ad09efcc23dc3045a03c20bd6ae44705a7ae2683c0b6686a87aa7ac"} Jun 02 02:52:37.776349 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.776325 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-6q8p2" event={"ID":"c8eeddf4-e81a-4a11-9417-b381dba3d581","Type":"ContainerStarted","Data":"93021d106ea730ed6b159e8f50ce826901d46106384f1cab23d94fb5a46b04e1"} Jun 02 02:52:37.777591 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.777567 2577 generic.go:358] "Generic (PLEG): container finished" podID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerID="87e332ff9db289a44c31a0dc795638c54f98898fc5d571df2e00ef40be8c7efe" exitCode=0 Jun 02 02:52:37.777682 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.777659 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" event={"ID":"9f04c179-36c3-47f1-9c57-ab7e569ed2aa","Type":"ContainerDied","Data":"87e332ff9db289a44c31a0dc795638c54f98898fc5d571df2e00ef40be8c7efe"} Jun 02 02:52:37.777724 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:37.777685 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" event={"ID":"9f04c179-36c3-47f1-9c57-ab7e569ed2aa","Type":"ContainerStarted","Data":"79c2847923d307382479f0c9dc4d639ed7c2b77deacfa7b147a5ff4e8bd51d43"} Jun 02 02:52:38.789572 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:38.788973 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" event={"ID":"9f04c179-36c3-47f1-9c57-ab7e569ed2aa","Type":"ContainerStarted","Data":"e38c29f225e3692bfc831dafe3c66ed8fd8a0e375befe0eda4ad06be49a1ae61"} Jun 02 02:52:39.794315 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:39.794276 2577 generic.go:358] "Generic (PLEG): container finished" podID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerID="e38c29f225e3692bfc831dafe3c66ed8fd8a0e375befe0eda4ad06be49a1ae61" exitCode=0 Jun 02 02:52:39.794731 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:39.794371 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" event={"ID":"9f04c179-36c3-47f1-9c57-ab7e569ed2aa","Type":"ContainerDied","Data":"e38c29f225e3692bfc831dafe3c66ed8fd8a0e375befe0eda4ad06be49a1ae61"} Jun 02 02:52:41.807052 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:41.807014 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" event={"ID":"2f355e56-2783-44d0-81ab-e01aa33d6278","Type":"ContainerStarted","Data":"aa837b901b695511fd5e668566d671aef0806bd319f54de53620056013f4482e"} Jun 02 02:52:41.808456 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:41.808426 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-6q8p2" event={"ID":"c8eeddf4-e81a-4a11-9417-b381dba3d581","Type":"ContainerStarted","Data":"c87b439345bcce14427e48b741cd2c173051c32bb8cf3c7c8b65c55a4e657bb6"} Jun 02 02:52:41.808607 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:41.808480 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:41.810353 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:41.810329 2577 generic.go:358] "Generic (PLEG): container finished" podID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerID="f5792df0e24da5f149c218ae209de16337cc13f7f81aa4f992d15099a313ba57" exitCode=0 Jun 02 02:52:41.810463 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:41.810406 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" event={"ID":"9f04c179-36c3-47f1-9c57-ab7e569ed2aa","Type":"ContainerDied","Data":"f5792df0e24da5f149c218ae209de16337cc13f7f81aa4f992d15099a313ba57"} Jun 02 02:52:41.824283 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:41.824244 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85d86d5b57-zwwcv" podStartSLOduration=2.358734001 podStartE2EDuration="5.824233115s" podCreationTimestamp="2026-06-02 02:52:36 +0000 UTC" firstStartedPulling="2026-06-02 02:52:37.257751113 +0000 UTC m=+433.350285410" lastFinishedPulling="2026-06-02 02:52:40.723250227 +0000 UTC m=+436.815784524" observedRunningTime="2026-06-02 02:52:41.822288896 +0000 UTC m=+437.914823212" watchObservedRunningTime="2026-06-02 02:52:41.824233115 +0000 UTC m=+437.916767441" Jun 02 02:52:41.855669 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:41.855619 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-6q8p2" podStartSLOduration=1.658706783 podStartE2EDuration="4.855606659s" podCreationTimestamp="2026-06-02 02:52:37 +0000 UTC" firstStartedPulling="2026-06-02 02:52:37.530420213 +0000 UTC m=+433.622954508" lastFinishedPulling="2026-06-02 02:52:40.727320081 +0000 UTC m=+436.819854384" observedRunningTime="2026-06-02 02:52:41.855138893 +0000 UTC m=+437.947673204" watchObservedRunningTime="2026-06-02 02:52:41.855606659 +0000 UTC m=+437.948140976" Jun 02 02:52:42.966051 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:42.966024 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:43.099597 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.099509 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-util\") pod \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " Jun 02 02:52:43.099597 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.099569 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh7rw\" (UniqueName: \"kubernetes.io/projected/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-kube-api-access-rh7rw\") pod \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " Jun 02 02:52:43.099826 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.099655 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-bundle\") pod \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\" (UID: \"9f04c179-36c3-47f1-9c57-ab7e569ed2aa\") " Jun 02 02:52:43.100642 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.100611 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-bundle" (OuterVolumeSpecName: "bundle") pod "9f04c179-36c3-47f1-9c57-ab7e569ed2aa" (UID: "9f04c179-36c3-47f1-9c57-ab7e569ed2aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:52:43.101702 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.101681 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-kube-api-access-rh7rw" (OuterVolumeSpecName: "kube-api-access-rh7rw") pod "9f04c179-36c3-47f1-9c57-ab7e569ed2aa" (UID: "9f04c179-36c3-47f1-9c57-ab7e569ed2aa"). InnerVolumeSpecName "kube-api-access-rh7rw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:52:43.103578 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.103556 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-util" (OuterVolumeSpecName: "util") pod "9f04c179-36c3-47f1-9c57-ab7e569ed2aa" (UID: "9f04c179-36c3-47f1-9c57-ab7e569ed2aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:52:43.200221 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.200196 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:43.200221 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.200219 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh7rw\" (UniqueName: \"kubernetes.io/projected/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-kube-api-access-rh7rw\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:43.200342 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.200231 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f04c179-36c3-47f1-9c57-ab7e569ed2aa-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:43.819437 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.819405 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" event={"ID":"9f04c179-36c3-47f1-9c57-ab7e569ed2aa","Type":"ContainerDied","Data":"79c2847923d307382479f0c9dc4d639ed7c2b77deacfa7b147a5ff4e8bd51d43"} Jun 02 02:52:43.819437 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.819436 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79c2847923d307382479f0c9dc4d639ed7c2b77deacfa7b147a5ff4e8bd51d43" Jun 02 02:52:43.819638 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:43.819481 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q5tsn" Jun 02 02:52:46.665331 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665292 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mt226"] Jun 02 02:52:46.665710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665609 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerName="pull" Jun 02 02:52:46.665710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665621 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerName="pull" Jun 02 02:52:46.665710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665631 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerName="extract" Jun 02 02:52:46.665710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665636 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerName="extract" Jun 02 02:52:46.665710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665648 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerName="util" Jun 02 02:52:46.665710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665653 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerName="util" Jun 02 02:52:46.665710 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.665709 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f04c179-36c3-47f1-9c57-ab7e569ed2aa" containerName="extract" Jun 02 02:52:46.671633 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.671604 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:46.679932 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.679913 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 02:52:46.680383 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.680364 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-b76dg\"" Jun 02 02:52:46.681777 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.681736 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz"] Jun 02 02:52:46.685784 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.685767 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mt226"] Jun 02 02:52:46.685913 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.685899 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:46.688322 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.688303 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 02:52:46.688607 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.688305 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w64fd\"" Jun 02 02:52:46.696931 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.696913 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz"] Jun 02 02:52:46.728582 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.728554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hl8\" (UniqueName: \"kubernetes.io/projected/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-kube-api-access-68hl8\") pod \"llmisvc-controller-manager-c6b9847d7-zlbpz\" (UID: \"42e334c0-32d5-49d2-a3c9-a20129f9b5b3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:46.728736 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.728589 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d5a3949-ae32-4bda-9816-6c8f44a0b91a-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mt226\" (UID: \"7d5a3949-ae32-4bda-9816-6c8f44a0b91a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:46.728736 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.728613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5dj2\" (UniqueName: \"kubernetes.io/projected/7d5a3949-ae32-4bda-9816-6c8f44a0b91a-kube-api-access-x5dj2\") pod \"kserve-controller-manager-7c99ffcdcd-mt226\" (UID: \"7d5a3949-ae32-4bda-9816-6c8f44a0b91a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:46.728736 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.728705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zlbpz\" (UID: \"42e334c0-32d5-49d2-a3c9-a20129f9b5b3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:46.829591 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.829565 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zlbpz\" (UID: \"42e334c0-32d5-49d2-a3c9-a20129f9b5b3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:46.829742 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.829658 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68hl8\" (UniqueName: \"kubernetes.io/projected/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-kube-api-access-68hl8\") pod \"llmisvc-controller-manager-c6b9847d7-zlbpz\" (UID: \"42e334c0-32d5-49d2-a3c9-a20129f9b5b3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:46.829742 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:52:46.829685 2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 02 02:52:46.829742 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.829696 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d5a3949-ae32-4bda-9816-6c8f44a0b91a-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mt226\" (UID: \"7d5a3949-ae32-4bda-9816-6c8f44a0b91a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:46.829742 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.829731 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5dj2\" (UniqueName: \"kubernetes.io/projected/7d5a3949-ae32-4bda-9816-6c8f44a0b91a-kube-api-access-x5dj2\") pod \"kserve-controller-manager-7c99ffcdcd-mt226\" (UID: \"7d5a3949-ae32-4bda-9816-6c8f44a0b91a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:46.830005 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:52:46.829747 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-cert podName:42e334c0-32d5-49d2-a3c9-a20129f9b5b3 nodeName:}" failed. No retries permitted until 2026-06-02 02:52:47.329724631 +0000 UTC m=+443.422258947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-cert") pod "llmisvc-controller-manager-c6b9847d7-zlbpz" (UID: "42e334c0-32d5-49d2-a3c9-a20129f9b5b3") : secret "llmisvc-webhook-server-cert" not found Jun 02 02:52:46.832429 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.832400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d5a3949-ae32-4bda-9816-6c8f44a0b91a-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mt226\" (UID: \"7d5a3949-ae32-4bda-9816-6c8f44a0b91a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:46.855432 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.855402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hl8\" (UniqueName: \"kubernetes.io/projected/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-kube-api-access-68hl8\") pod \"llmisvc-controller-manager-c6b9847d7-zlbpz\" (UID: \"42e334c0-32d5-49d2-a3c9-a20129f9b5b3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:46.856332 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.856306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5dj2\" (UniqueName: \"kubernetes.io/projected/7d5a3949-ae32-4bda-9816-6c8f44a0b91a-kube-api-access-x5dj2\") pod \"kserve-controller-manager-7c99ffcdcd-mt226\" (UID: \"7d5a3949-ae32-4bda-9816-6c8f44a0b91a\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:46.983833 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:46.983807 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:47.150500 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:47.150447 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mt226"] Jun 02 02:52:47.153818 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:47.153787 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5a3949_ae32_4bda_9816_6c8f44a0b91a.slice/crio-682647fda7a0876469afdfa6a27437185b204f46e822ae81522ad28dd8134d6c WatchSource:0}: Error finding container 682647fda7a0876469afdfa6a27437185b204f46e822ae81522ad28dd8134d6c: Status 404 returned error can't find the container with id 682647fda7a0876469afdfa6a27437185b204f46e822ae81522ad28dd8134d6c Jun 02 02:52:47.335157 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:47.335084 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zlbpz\" (UID: \"42e334c0-32d5-49d2-a3c9-a20129f9b5b3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:47.339912 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:47.338548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42e334c0-32d5-49d2-a3c9-a20129f9b5b3-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zlbpz\" (UID: \"42e334c0-32d5-49d2-a3c9-a20129f9b5b3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:47.598362 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:47.598277 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:47.732820 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:47.732795 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz"] Jun 02 02:52:47.734393 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:47.734348 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42e334c0_32d5_49d2_a3c9_a20129f9b5b3.slice/crio-e4574c0a648b61fa5ff1648ad18e40abc2ea61219a70d33b3bf42dca9057f6ce WatchSource:0}: Error finding container e4574c0a648b61fa5ff1648ad18e40abc2ea61219a70d33b3bf42dca9057f6ce: Status 404 returned error can't find the container with id e4574c0a648b61fa5ff1648ad18e40abc2ea61219a70d33b3bf42dca9057f6ce Jun 02 02:52:47.835094 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:47.835057 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" event={"ID":"7d5a3949-ae32-4bda-9816-6c8f44a0b91a","Type":"ContainerStarted","Data":"682647fda7a0876469afdfa6a27437185b204f46e822ae81522ad28dd8134d6c"} Jun 02 02:52:47.836258 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:47.836231 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" event={"ID":"42e334c0-32d5-49d2-a3c9-a20129f9b5b3","Type":"ContainerStarted","Data":"e4574c0a648b61fa5ff1648ad18e40abc2ea61219a70d33b3bf42dca9057f6ce"} Jun 02 02:52:51.027711 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.027683 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r"] Jun 02 02:52:51.035709 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.035675 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.039560 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.039534 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:52:51.040422 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.040401 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rr7ds\"" Jun 02 02:52:51.040566 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.040426 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:52:51.050742 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.050718 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r"] Jun 02 02:52:51.075449 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.075411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnx6\" (UniqueName: \"kubernetes.io/projected/248abf50-8924-4a48-ad5c-57e45355ae6d-kube-api-access-gsnx6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.075604 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.075462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.075604 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.075532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.176540 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.176442 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnx6\" (UniqueName: \"kubernetes.io/projected/248abf50-8924-4a48-ad5c-57e45355ae6d-kube-api-access-gsnx6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.176540 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.176513 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.176787 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.176574 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.177282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.177011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.177282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.177218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.189304 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.189278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnx6\" (UniqueName: \"kubernetes.io/projected/248abf50-8924-4a48-ad5c-57e45355ae6d-kube-api-access-gsnx6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.345716 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.345684 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:51.676918 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.676885 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp"] Jun 02 02:52:51.680039 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.680021 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:51.683828 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.683797 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bvb9s\"" Jun 02 02:52:51.683950 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.683883 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 02:52:51.699049 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.699021 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp"] Jun 02 02:52:51.784654 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.784619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a5c2e52d-50a0-4718-81ef-e377fb1a5f63-redirect-config\") pod \"dashboard-redirect-6d9fb5d8dc-nbphp\" (UID: \"a5c2e52d-50a0-4718-81ef-e377fb1a5f63\") " pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:51.784837 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.784689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l49df\" (UniqueName: \"kubernetes.io/projected/a5c2e52d-50a0-4718-81ef-e377fb1a5f63-kube-api-access-l49df\") pod \"dashboard-redirect-6d9fb5d8dc-nbphp\" (UID: \"a5c2e52d-50a0-4718-81ef-e377fb1a5f63\") " pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:51.885762 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.885727 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a5c2e52d-50a0-4718-81ef-e377fb1a5f63-redirect-config\") pod \"dashboard-redirect-6d9fb5d8dc-nbphp\" (UID: \"a5c2e52d-50a0-4718-81ef-e377fb1a5f63\") " pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:51.885960 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.885773 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l49df\" (UniqueName: \"kubernetes.io/projected/a5c2e52d-50a0-4718-81ef-e377fb1a5f63-kube-api-access-l49df\") pod \"dashboard-redirect-6d9fb5d8dc-nbphp\" (UID: \"a5c2e52d-50a0-4718-81ef-e377fb1a5f63\") " pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:51.886402 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.886378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a5c2e52d-50a0-4718-81ef-e377fb1a5f63-redirect-config\") pod \"dashboard-redirect-6d9fb5d8dc-nbphp\" (UID: \"a5c2e52d-50a0-4718-81ef-e377fb1a5f63\") " pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:51.905225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.905198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l49df\" (UniqueName: \"kubernetes.io/projected/a5c2e52d-50a0-4718-81ef-e377fb1a5f63-kube-api-access-l49df\") pod \"dashboard-redirect-6d9fb5d8dc-nbphp\" (UID: \"a5c2e52d-50a0-4718-81ef-e377fb1a5f63\") " pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:51.994642 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:51.994489 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" Jun 02 02:52:52.057288 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.056927 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r"] Jun 02 02:52:52.059140 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:52.058901 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248abf50_8924_4a48_ad5c_57e45355ae6d.slice/crio-d67478a032a206a3478a0c77c3c87fe3f36cefeac585e17b804a25ce6157878a WatchSource:0}: Error finding container d67478a032a206a3478a0c77c3c87fe3f36cefeac585e17b804a25ce6157878a: Status 404 returned error can't find the container with id d67478a032a206a3478a0c77c3c87fe3f36cefeac585e17b804a25ce6157878a Jun 02 02:52:52.143215 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.143184 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp"] Jun 02 02:52:52.145220 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:52.145195 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c2e52d_50a0_4718_81ef_e377fb1a5f63.slice/crio-4a94e1b71deed4f5be69ca27bbb898fbc3e4ba8e886fa845e769d12f3ff8bf07 WatchSource:0}: Error finding container 4a94e1b71deed4f5be69ca27bbb898fbc3e4ba8e886fa845e769d12f3ff8bf07: Status 404 returned error can't find the container with id 4a94e1b71deed4f5be69ca27bbb898fbc3e4ba8e886fa845e769d12f3ff8bf07 Jun 02 02:52:52.338940 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.338900 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9mn49"] Jun 02 02:52:52.341161 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.341140 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.344094 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.344068 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-smv5r\"" Jun 02 02:52:52.344340 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.344321 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 02:52:52.344415 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.344350 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 02:52:52.354721 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.354696 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9mn49"] Jun 02 02:52:52.390044 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.390012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbxp5\" (UniqueName: \"kubernetes.io/projected/055d2c81-04cf-42c5-ad19-67ffb9df9a95-kube-api-access-sbxp5\") pod \"servicemesh-operator3-55f49c5f94-9mn49\" (UID: \"055d2c81-04cf-42c5-ad19-67ffb9df9a95\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.390154 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.390049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/055d2c81-04cf-42c5-ad19-67ffb9df9a95-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9mn49\" (UID: \"055d2c81-04cf-42c5-ad19-67ffb9df9a95\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.490775 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.490736 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxp5\" (UniqueName: \"kubernetes.io/projected/055d2c81-04cf-42c5-ad19-67ffb9df9a95-kube-api-access-sbxp5\") pod \"servicemesh-operator3-55f49c5f94-9mn49\" (UID: \"055d2c81-04cf-42c5-ad19-67ffb9df9a95\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.490775 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.490784 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/055d2c81-04cf-42c5-ad19-67ffb9df9a95-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9mn49\" (UID: \"055d2c81-04cf-42c5-ad19-67ffb9df9a95\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.493191 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.493172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/055d2c81-04cf-42c5-ad19-67ffb9df9a95-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9mn49\" (UID: \"055d2c81-04cf-42c5-ad19-67ffb9df9a95\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.501557 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.501527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbxp5\" (UniqueName: \"kubernetes.io/projected/055d2c81-04cf-42c5-ad19-67ffb9df9a95-kube-api-access-sbxp5\") pod \"servicemesh-operator3-55f49c5f94-9mn49\" (UID: \"055d2c81-04cf-42c5-ad19-67ffb9df9a95\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.659326 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.659251 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:52.788406 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.788370 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9mn49"] Jun 02 02:52:52.790023 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:52.790000 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055d2c81_04cf_42c5_ad19_67ffb9df9a95.slice/crio-c9cc65ea53b3327d60e7a807686e156633299acb9501fb73491ae1ac3b0166c2 WatchSource:0}: Error finding container c9cc65ea53b3327d60e7a807686e156633299acb9501fb73491ae1ac3b0166c2: Status 404 returned error can't find the container with id c9cc65ea53b3327d60e7a807686e156633299acb9501fb73491ae1ac3b0166c2 Jun 02 02:52:52.817808 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.817787 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-6q8p2" Jun 02 02:52:52.858901 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.858847 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" event={"ID":"a5c2e52d-50a0-4718-81ef-e377fb1a5f63","Type":"ContainerStarted","Data":"4a94e1b71deed4f5be69ca27bbb898fbc3e4ba8e886fa845e769d12f3ff8bf07"} Jun 02 02:52:52.860249 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.860225 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" event={"ID":"055d2c81-04cf-42c5-ad19-67ffb9df9a95","Type":"ContainerStarted","Data":"c9cc65ea53b3327d60e7a807686e156633299acb9501fb73491ae1ac3b0166c2"} Jun 02 02:52:52.861723 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.861699 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" event={"ID":"7d5a3949-ae32-4bda-9816-6c8f44a0b91a","Type":"ContainerStarted","Data":"b48bf25ad43548dc03ac91c07e7a14bd1f2e1769fc43e70448cf7dcb73cb0f50"} Jun 02 02:52:52.861871 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.861843 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:52:52.863145 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.863109 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" event={"ID":"42e334c0-32d5-49d2-a3c9-a20129f9b5b3","Type":"ContainerStarted","Data":"0ae4f11b5278e23e732e206b5973f3a2b55e5c6c2c03bb85743c50a3891cec3e"} Jun 02 02:52:52.863288 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.863271 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:52:52.864373 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.864352 2577 generic.go:358] "Generic (PLEG): container finished" podID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerID="d0dffe083406d8c831691daf13b7348fde51380a876adae82a573b4aefe0b88b" exitCode=0 Jun 02 02:52:52.864460 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.864385 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" event={"ID":"248abf50-8924-4a48-ad5c-57e45355ae6d","Type":"ContainerDied","Data":"d0dffe083406d8c831691daf13b7348fde51380a876adae82a573b4aefe0b88b"} Jun 02 02:52:52.864460 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.864401 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" event={"ID":"248abf50-8924-4a48-ad5c-57e45355ae6d","Type":"ContainerStarted","Data":"d67478a032a206a3478a0c77c3c87fe3f36cefeac585e17b804a25ce6157878a"} Jun 02 02:52:52.894451 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.894407 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" podStartSLOduration=3.572976944 podStartE2EDuration="6.894393896s" podCreationTimestamp="2026-06-02 02:52:46 +0000 UTC" firstStartedPulling="2026-06-02 02:52:47.155098035 +0000 UTC m=+443.247632331" lastFinishedPulling="2026-06-02 02:52:50.476514984 +0000 UTC m=+446.569049283" observedRunningTime="2026-06-02 02:52:52.892190583 +0000 UTC m=+448.984724900" watchObservedRunningTime="2026-06-02 02:52:52.894393896 +0000 UTC m=+448.986928213" Jun 02 02:52:52.919081 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:52.918994 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" podStartSLOduration=2.734093795 podStartE2EDuration="6.918978492s" podCreationTimestamp="2026-06-02 02:52:46 +0000 UTC" firstStartedPulling="2026-06-02 02:52:47.735735937 +0000 UTC m=+443.828270233" lastFinishedPulling="2026-06-02 02:52:51.920620619 +0000 UTC m=+448.013154930" observedRunningTime="2026-06-02 02:52:52.91772267 +0000 UTC m=+449.010256987" watchObservedRunningTime="2026-06-02 02:52:52.918978492 +0000 UTC m=+449.011512812" Jun 02 02:52:53.872430 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:53.872260 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" event={"ID":"248abf50-8924-4a48-ad5c-57e45355ae6d","Type":"ContainerStarted","Data":"f443406426dec0b03ea02d597a6a92dcb2899362ff88144bdb013593057f0ccc"} Jun 02 02:52:54.879378 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:54.879306 2577 generic.go:358] "Generic (PLEG): container finished" podID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerID="f443406426dec0b03ea02d597a6a92dcb2899362ff88144bdb013593057f0ccc" exitCode=0 Jun 02 02:52:54.879853 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:54.879460 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" event={"ID":"248abf50-8924-4a48-ad5c-57e45355ae6d","Type":"ContainerDied","Data":"f443406426dec0b03ea02d597a6a92dcb2899362ff88144bdb013593057f0ccc"} Jun 02 02:52:55.885381 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:55.885348 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" event={"ID":"a5c2e52d-50a0-4718-81ef-e377fb1a5f63","Type":"ContainerStarted","Data":"24c37d079409c22bfd3d05d15e46611cfdbc780feda87d842a0a1a9bd20cac3f"} Jun 02 02:52:55.887095 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:55.887064 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" event={"ID":"055d2c81-04cf-42c5-ad19-67ffb9df9a95","Type":"ContainerStarted","Data":"87894de4daf86ae42d6f41bfefcf76b13394a98f06afe3d11d6f46aa42de1888"} Jun 02 02:52:55.887254 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:55.887166 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:52:55.889100 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:55.889077 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" event={"ID":"248abf50-8924-4a48-ad5c-57e45355ae6d","Type":"ContainerStarted","Data":"6fb855849099be962e237042d02af204e3f10154ff5aaf5f1a7f8b2b61b8b8a3"} Jun 02 02:52:55.905301 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:55.905221 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d9fb5d8dc-nbphp" podStartSLOduration=1.376904449 podStartE2EDuration="4.905203222s" podCreationTimestamp="2026-06-02 02:52:51 +0000 UTC" firstStartedPulling="2026-06-02 02:52:52.146981434 +0000 UTC m=+448.239515729" lastFinishedPulling="2026-06-02 02:52:55.675280188 +0000 UTC m=+451.767814502" observedRunningTime="2026-06-02 02:52:55.903061347 +0000 UTC m=+451.995595684" watchObservedRunningTime="2026-06-02 02:52:55.905203222 +0000 UTC m=+451.997737543" Jun 02 02:52:55.955486 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:55.955423 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" podStartSLOduration=1.017931662 podStartE2EDuration="3.955404355s" podCreationTimestamp="2026-06-02 02:52:52 +0000 UTC" firstStartedPulling="2026-06-02 02:52:52.792365329 +0000 UTC m=+448.884899624" lastFinishedPulling="2026-06-02 02:52:55.729838004 +0000 UTC m=+451.822372317" observedRunningTime="2026-06-02 02:52:55.932478965 +0000 UTC m=+452.025013287" watchObservedRunningTime="2026-06-02 02:52:55.955404355 +0000 UTC m=+452.047938676" Jun 02 02:52:55.956307 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:55.956265 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" podStartSLOduration=5.283908572 podStartE2EDuration="5.956252833s" podCreationTimestamp="2026-06-02 02:52:50 +0000 UTC" firstStartedPulling="2026-06-02 02:52:52.865432053 +0000 UTC m=+448.957966352" lastFinishedPulling="2026-06-02 02:52:53.537776311 +0000 UTC m=+449.630310613" observedRunningTime="2026-06-02 02:52:55.953346003 +0000 UTC m=+452.045880303" watchObservedRunningTime="2026-06-02 02:52:55.956252833 +0000 UTC m=+452.048787152" Jun 02 02:52:56.807971 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.807940 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8"] Jun 02 02:52:56.810393 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.810367 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:56.813369 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.813334 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 02:52:56.813369 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.813347 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 02:52:56.813546 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.813347 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 02:52:56.813615 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.813339 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r465p\"" Jun 02 02:52:56.813751 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.813731 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 02:52:56.823604 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.823585 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8"] Jun 02 02:52:56.894704 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.894671 2577 generic.go:358] "Generic (PLEG): container finished" podID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerID="6fb855849099be962e237042d02af204e3f10154ff5aaf5f1a7f8b2b61b8b8a3" exitCode=0 Jun 02 02:52:56.895091 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.894757 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" event={"ID":"248abf50-8924-4a48-ad5c-57e45355ae6d","Type":"ContainerDied","Data":"6fb855849099be962e237042d02af204e3f10154ff5aaf5f1a7f8b2b61b8b8a3"} Jun 02 02:52:56.938726 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.938686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:56.938918 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.938735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37695f29-1db3-40af-9fdf-059f00fefea6-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:56.938918 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.938759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:56.938918 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.938802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:56.939080 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.938986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37695f29-1db3-40af-9fdf-059f00fefea6-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:56.939080 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.939060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37695f29-1db3-40af-9fdf-059f00fefea6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:56.939183 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:56.939091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pcmd\" (UniqueName: \"kubernetes.io/projected/37695f29-1db3-40af-9fdf-059f00fefea6-kube-api-access-7pcmd\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.039814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.039772 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.039814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.039814 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37695f29-1db3-40af-9fdf-059f00fefea6-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.040086 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.039831 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.040086 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.039889 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.040086 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.039928 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37695f29-1db3-40af-9fdf-059f00fefea6-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.040086 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.039976 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37695f29-1db3-40af-9fdf-059f00fefea6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.040086 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.040042 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pcmd\" (UniqueName: \"kubernetes.io/projected/37695f29-1db3-40af-9fdf-059f00fefea6-kube-api-access-7pcmd\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.040684 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.040654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/37695f29-1db3-40af-9fdf-059f00fefea6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.042273 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.042170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/37695f29-1db3-40af-9fdf-059f00fefea6-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.042433 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.042409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.042589 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.042567 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.042650 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.042630 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37695f29-1db3-40af-9fdf-059f00fefea6-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.048522 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.048502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37695f29-1db3-40af-9fdf-059f00fefea6-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.048844 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.048823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pcmd\" (UniqueName: \"kubernetes.io/projected/37695f29-1db3-40af-9fdf-059f00fefea6-kube-api-access-7pcmd\") pod \"istiod-openshift-gateway-798958bb55-mvcs8\" (UID: \"37695f29-1db3-40af-9fdf-059f00fefea6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.120204 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.120129 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:52:57.261494 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.261454 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8"] Jun 02 02:52:57.262271 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:52:57.262243 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37695f29_1db3_40af_9fdf_059f00fefea6.slice/crio-9f13954cdbe0ce040072f69c067a6e262b01a2fe38aa49b63337c41782062f5a WatchSource:0}: Error finding container 9f13954cdbe0ce040072f69c067a6e262b01a2fe38aa49b63337c41782062f5a: Status 404 returned error can't find the container with id 9f13954cdbe0ce040072f69c067a6e262b01a2fe38aa49b63337c41782062f5a Jun 02 02:52:57.900851 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:57.900814 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" event={"ID":"37695f29-1db3-40af-9fdf-059f00fefea6","Type":"ContainerStarted","Data":"9f13954cdbe0ce040072f69c067a6e262b01a2fe38aa49b63337c41782062f5a"} Jun 02 02:52:58.027984 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.027959 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:58.150436 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.150398 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-util\") pod \"248abf50-8924-4a48-ad5c-57e45355ae6d\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " Jun 02 02:52:58.150609 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.150488 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-bundle\") pod \"248abf50-8924-4a48-ad5c-57e45355ae6d\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " Jun 02 02:52:58.150609 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.150576 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsnx6\" (UniqueName: \"kubernetes.io/projected/248abf50-8924-4a48-ad5c-57e45355ae6d-kube-api-access-gsnx6\") pod \"248abf50-8924-4a48-ad5c-57e45355ae6d\" (UID: \"248abf50-8924-4a48-ad5c-57e45355ae6d\") " Jun 02 02:52:58.151626 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.151548 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-bundle" (OuterVolumeSpecName: "bundle") pod "248abf50-8924-4a48-ad5c-57e45355ae6d" (UID: "248abf50-8924-4a48-ad5c-57e45355ae6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:52:58.153150 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.153115 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/248abf50-8924-4a48-ad5c-57e45355ae6d-kube-api-access-gsnx6" (OuterVolumeSpecName: "kube-api-access-gsnx6") pod "248abf50-8924-4a48-ad5c-57e45355ae6d" (UID: "248abf50-8924-4a48-ad5c-57e45355ae6d"). InnerVolumeSpecName "kube-api-access-gsnx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:52:58.157310 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.157179 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-util" (OuterVolumeSpecName: "util") pod "248abf50-8924-4a48-ad5c-57e45355ae6d" (UID: "248abf50-8924-4a48-ad5c-57e45355ae6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:52:58.254841 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.254808 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:58.254841 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.254840 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/248abf50-8924-4a48-ad5c-57e45355ae6d-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:58.254841 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.254872 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsnx6\" (UniqueName: \"kubernetes.io/projected/248abf50-8924-4a48-ad5c-57e45355ae6d-kube-api-access-gsnx6\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:52:58.907175 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.907134 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" event={"ID":"248abf50-8924-4a48-ad5c-57e45355ae6d","Type":"ContainerDied","Data":"d67478a032a206a3478a0c77c3c87fe3f36cefeac585e17b804a25ce6157878a"} Jun 02 02:52:58.907175 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.907173 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aszv6r" Jun 02 02:52:58.907689 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:58.907175 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d67478a032a206a3478a0c77c3c87fe3f36cefeac585e17b804a25ce6157878a" Jun 02 02:52:59.976224 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:59.976180 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 02:52:59.976503 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:52:59.976265 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 02 02:53:00.917296 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:00.917256 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" event={"ID":"37695f29-1db3-40af-9fdf-059f00fefea6","Type":"ContainerStarted","Data":"0bdbbc9a237f9f2608d9e8131b94def2b71fc666e94e604f902c784593f74bf1"} Jun 02 02:53:00.917481 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:00.917342 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:53:00.940366 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:00.940310 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" podStartSLOduration=2.228845245 podStartE2EDuration="4.940291638s" podCreationTimestamp="2026-06-02 02:52:56 +0000 UTC" firstStartedPulling="2026-06-02 02:52:57.264453181 +0000 UTC m=+453.356987480" lastFinishedPulling="2026-06-02 02:52:59.975899573 +0000 UTC m=+456.068433873" observedRunningTime="2026-06-02 02:53:00.937995442 +0000 UTC m=+457.030529762" watchObservedRunningTime="2026-06-02 02:53:00.940291638 +0000 UTC m=+457.032825957" Jun 02 02:53:01.924260 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:01.924208 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-mvcs8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 02:53:01.924707 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:01.924285 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" podUID="37695f29-1db3-40af-9fdf-059f00fefea6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 02:53:04.922963 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:04.922932 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mvcs8" Jun 02 02:53:06.897669 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:06.897638 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9mn49" Jun 02 02:53:23.874531 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:23.874494 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zlbpz" Jun 02 02:53:23.877478 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:23.877459 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mt226" Jun 02 02:53:53.387816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.387780 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6"] Jun 02 02:53:53.388302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.388143 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerName="util" Jun 02 02:53:53.388302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.388156 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerName="util" Jun 02 02:53:53.388302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.388164 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerName="extract" Jun 02 02:53:53.388302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.388170 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerName="extract" Jun 02 02:53:53.388302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.388184 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerName="pull" Jun 02 02:53:53.388302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.388190 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerName="pull" Jun 02 02:53:53.388302 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.388244 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="248abf50-8924-4a48-ad5c-57e45355ae6d" containerName="extract" Jun 02 02:53:53.390247 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.390231 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.392928 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.392908 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mcdtr\"" Jun 02 02:53:53.393042 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.392944 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 02:53:53.393957 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.393936 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 02:53:53.400101 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.400081 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6"] Jun 02 02:53:53.522295 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.522266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.522457 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.522323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.522457 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.522393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddw48\" (UniqueName: \"kubernetes.io/projected/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-kube-api-access-ddw48\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.623549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.623522 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.623698 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.623584 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.623698 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.623622 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddw48\" (UniqueName: \"kubernetes.io/projected/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-kube-api-access-ddw48\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.624024 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.624006 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.624069 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.624045 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.631999 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.631973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddw48\" (UniqueName: \"kubernetes.io/projected/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-kube-api-access-ddw48\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.701321 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.701248 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:53.841846 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:53.841819 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6"] Jun 02 02:53:53.843885 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:53:53.843842 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff58320_29b7_4e49_a44a_5b9ec7727dcc.slice/crio-1bf1a1eabfb5bb31165b96d725a5921f2a97b0b03a4adfd3b913d0d4b95e63ec WatchSource:0}: Error finding container 1bf1a1eabfb5bb31165b96d725a5921f2a97b0b03a4adfd3b913d0d4b95e63ec: Status 404 returned error can't find the container with id 1bf1a1eabfb5bb31165b96d725a5921f2a97b0b03a4adfd3b913d0d4b95e63ec Jun 02 02:53:54.109949 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.109901 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl"] Jun 02 02:53:54.112716 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.112694 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.114325 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.114294 2577 generic.go:358] "Generic (PLEG): container finished" podID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerID="ee0bb78415edab459baa319ec2a983325892626919a32b9a8be838050f7d3532" exitCode=0 Jun 02 02:53:54.114465 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.114373 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" event={"ID":"0ff58320-29b7-4e49-a44a-5b9ec7727dcc","Type":"ContainerDied","Data":"ee0bb78415edab459baa319ec2a983325892626919a32b9a8be838050f7d3532"} Jun 02 02:53:54.114465 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.114403 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" event={"ID":"0ff58320-29b7-4e49-a44a-5b9ec7727dcc","Type":"ContainerStarted","Data":"1bf1a1eabfb5bb31165b96d725a5921f2a97b0b03a4adfd3b913d0d4b95e63ec"} Jun 02 02:53:54.120881 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.120836 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl"] Jun 02 02:53:54.229088 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.229058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvn7j\" (UniqueName: \"kubernetes.io/projected/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-kube-api-access-rvn7j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.229242 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.229114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.229242 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.229150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.330542 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.330508 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.330542 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.330547 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.330741 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.330629 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvn7j\" (UniqueName: \"kubernetes.io/projected/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-kube-api-access-rvn7j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.330926 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.330908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.330988 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.330971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.338641 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.338618 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvn7j\" (UniqueName: \"kubernetes.io/projected/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-kube-api-access-rvn7j\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.423658 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.423587 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:54.559419 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.559397 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl"] Jun 02 02:53:54.560822 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:53:54.560795 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05875ee_7296_4bbb_a110_7d5c2c9ae81d.slice/crio-6fd6abca388c1dd8b568ab5c76622ba18619748dfc2bf8d15cc7c373fdc8de4a WatchSource:0}: Error finding container 6fd6abca388c1dd8b568ab5c76622ba18619748dfc2bf8d15cc7c373fdc8de4a: Status 404 returned error can't find the container with id 6fd6abca388c1dd8b568ab5c76622ba18619748dfc2bf8d15cc7c373fdc8de4a Jun 02 02:53:54.953034 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.953005 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn"] Jun 02 02:53:54.956113 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.956096 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:54.973006 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:54.972983 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn"] Jun 02 02:53:55.038019 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.037995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.038142 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.038032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.038142 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.038049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ckns\" (UniqueName: \"kubernetes.io/projected/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-kube-api-access-2ckns\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.122053 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.121974 2577 generic.go:358] "Generic (PLEG): container finished" podID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerID="e681e19522f1ce6ad500653804054a0006a3b8c7fbe51b7ff711f82ed2ae4cba" exitCode=0 Jun 02 02:53:55.122173 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.122063 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" event={"ID":"0ff58320-29b7-4e49-a44a-5b9ec7727dcc","Type":"ContainerDied","Data":"e681e19522f1ce6ad500653804054a0006a3b8c7fbe51b7ff711f82ed2ae4cba"} Jun 02 02:53:55.123395 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.123367 2577 generic.go:358] "Generic (PLEG): container finished" podID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerID="53e31165a9da76a45db4b5a6ce5abd5262bb739c8b2d964f9120fc311b4df023" exitCode=0 Jun 02 02:53:55.123492 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.123434 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" event={"ID":"e05875ee-7296-4bbb-a110-7d5c2c9ae81d","Type":"ContainerDied","Data":"53e31165a9da76a45db4b5a6ce5abd5262bb739c8b2d964f9120fc311b4df023"} Jun 02 02:53:55.123492 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.123461 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" event={"ID":"e05875ee-7296-4bbb-a110-7d5c2c9ae81d","Type":"ContainerStarted","Data":"6fd6abca388c1dd8b568ab5c76622ba18619748dfc2bf8d15cc7c373fdc8de4a"} Jun 02 02:53:55.139397 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.138786 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.139397 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.138832 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.139397 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.138887 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckns\" (UniqueName: \"kubernetes.io/projected/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-kube-api-access-2ckns\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.139606 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.139548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.139783 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.139763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.146225 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.146201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ckns\" (UniqueName: \"kubernetes.io/projected/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-kube-api-access-2ckns\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.265400 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.265371 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:55.369915 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.369875 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-796c74c885-bvhlm"] Jun 02 02:53:55.403563 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.403537 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn"] Jun 02 02:53:55.405320 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:53:55.405292 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc649ba0_846c_4ec3_8d2d_f81736b7c6fd.slice/crio-43bca4c7845c658b1f839497141f272dd85a39e6da76e109124cc84904063b8d WatchSource:0}: Error finding container 43bca4c7845c658b1f839497141f272dd85a39e6da76e109124cc84904063b8d: Status 404 returned error can't find the container with id 43bca4c7845c658b1f839497141f272dd85a39e6da76e109124cc84904063b8d Jun 02 02:53:55.513075 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.513048 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc"] Jun 02 02:53:55.515943 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.515922 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.524127 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.524105 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc"] Jun 02 02:53:55.643621 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.643589 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.643842 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.643636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7llt\" (UniqueName: \"kubernetes.io/projected/b58ce261-7558-48df-ab1b-1e4586d0778d-kube-api-access-f7llt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.643842 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.643709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.745275 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.745235 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.745275 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.745278 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7llt\" (UniqueName: \"kubernetes.io/projected/b58ce261-7558-48df-ab1b-1e4586d0778d-kube-api-access-f7llt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.745497 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.745325 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.745650 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.745630 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.745692 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.745659 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.754520 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.754483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7llt\" (UniqueName: \"kubernetes.io/projected/b58ce261-7558-48df-ab1b-1e4586d0778d-kube-api-access-f7llt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:55.868834 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:55.868798 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:53:56.010000 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.009973 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc"] Jun 02 02:53:56.011799 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:53:56.011772 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58ce261_7558_48df_ab1b_1e4586d0778d.slice/crio-a32977a703fdfe9eddffdb89ed68485b19b27557c83d7fb43f01ce18d2f2b7ee WatchSource:0}: Error finding container a32977a703fdfe9eddffdb89ed68485b19b27557c83d7fb43f01ce18d2f2b7ee: Status 404 returned error can't find the container with id a32977a703fdfe9eddffdb89ed68485b19b27557c83d7fb43f01ce18d2f2b7ee Jun 02 02:53:56.128884 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.128829 2577 generic.go:358] "Generic (PLEG): container finished" podID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerID="5214efcc159959e711e3edf35c8ef1fc3701660e7bb77e4fb6f4abc178308970" exitCode=0 Jun 02 02:53:56.129040 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.128920 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" event={"ID":"0ff58320-29b7-4e49-a44a-5b9ec7727dcc","Type":"ContainerDied","Data":"5214efcc159959e711e3edf35c8ef1fc3701660e7bb77e4fb6f4abc178308970"} Jun 02 02:53:56.130298 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.130273 2577 generic.go:358] "Generic (PLEG): container finished" podID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerID="bc2ce802a184f9ab98281a1fe29b5c96e949ecb2d3224c952d40da054189ad79" exitCode=0 Jun 02 02:53:56.130406 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.130350 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" event={"ID":"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd","Type":"ContainerDied","Data":"bc2ce802a184f9ab98281a1fe29b5c96e949ecb2d3224c952d40da054189ad79"} Jun 02 02:53:56.130406 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.130378 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" event={"ID":"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd","Type":"ContainerStarted","Data":"43bca4c7845c658b1f839497141f272dd85a39e6da76e109124cc84904063b8d"} Jun 02 02:53:56.132201 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.132181 2577 generic.go:358] "Generic (PLEG): container finished" podID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerID="042e1288d30207020c47b94af3ad6bcb2b20976abbd4222bdd60f63de98f9ff6" exitCode=0 Jun 02 02:53:56.132322 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.132255 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" event={"ID":"e05875ee-7296-4bbb-a110-7d5c2c9ae81d","Type":"ContainerDied","Data":"042e1288d30207020c47b94af3ad6bcb2b20976abbd4222bdd60f63de98f9ff6"} Jun 02 02:53:56.134083 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.134019 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" event={"ID":"b58ce261-7558-48df-ab1b-1e4586d0778d","Type":"ContainerStarted","Data":"72d51246ba05b0dc0d699808068e922f5b6c84bf8749027db67b20b816b3f329"} Jun 02 02:53:56.134083 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:56.134045 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" event={"ID":"b58ce261-7558-48df-ab1b-1e4586d0778d","Type":"ContainerStarted","Data":"a32977a703fdfe9eddffdb89ed68485b19b27557c83d7fb43f01ce18d2f2b7ee"} Jun 02 02:53:57.138696 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.138662 2577 generic.go:358] "Generic (PLEG): container finished" podID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerID="72d51246ba05b0dc0d699808068e922f5b6c84bf8749027db67b20b816b3f329" exitCode=0 Jun 02 02:53:57.139184 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.138754 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" event={"ID":"b58ce261-7558-48df-ab1b-1e4586d0778d","Type":"ContainerDied","Data":"72d51246ba05b0dc0d699808068e922f5b6c84bf8749027db67b20b816b3f329"} Jun 02 02:53:57.140492 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.140473 2577 generic.go:358] "Generic (PLEG): container finished" podID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerID="79180d84ac6dee1d6966e611d28df680c6692323f4412b0684114924cfd7b582" exitCode=0 Jun 02 02:53:57.140885 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.140552 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" event={"ID":"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd","Type":"ContainerDied","Data":"79180d84ac6dee1d6966e611d28df680c6692323f4412b0684114924cfd7b582"} Jun 02 02:53:57.142481 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.142460 2577 generic.go:358] "Generic (PLEG): container finished" podID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerID="9320322ee3d3bb3e4cc701a5854d4983032d75fa4e778e747222dd7b856d28a4" exitCode=0 Jun 02 02:53:57.142565 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.142520 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" event={"ID":"e05875ee-7296-4bbb-a110-7d5c2c9ae81d","Type":"ContainerDied","Data":"9320322ee3d3bb3e4cc701a5854d4983032d75fa4e778e747222dd7b856d28a4"} Jun 02 02:53:57.281399 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.281375 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:57.358670 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.358632 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddw48\" (UniqueName: \"kubernetes.io/projected/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-kube-api-access-ddw48\") pod \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " Jun 02 02:53:57.358819 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.358716 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-bundle\") pod \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " Jun 02 02:53:57.358819 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.358764 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-util\") pod \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\" (UID: \"0ff58320-29b7-4e49-a44a-5b9ec7727dcc\") " Jun 02 02:53:57.359446 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.359419 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-bundle" (OuterVolumeSpecName: "bundle") pod "0ff58320-29b7-4e49-a44a-5b9ec7727dcc" (UID: "0ff58320-29b7-4e49-a44a-5b9ec7727dcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:53:57.360829 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.360801 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-kube-api-access-ddw48" (OuterVolumeSpecName: "kube-api-access-ddw48") pod "0ff58320-29b7-4e49-a44a-5b9ec7727dcc" (UID: "0ff58320-29b7-4e49-a44a-5b9ec7727dcc"). InnerVolumeSpecName "kube-api-access-ddw48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:53:57.364239 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.364218 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-util" (OuterVolumeSpecName: "util") pod "0ff58320-29b7-4e49-a44a-5b9ec7727dcc" (UID: "0ff58320-29b7-4e49-a44a-5b9ec7727dcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:53:57.460346 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.460318 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:57.460346 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.460347 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:57.460521 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:57.460358 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddw48\" (UniqueName: \"kubernetes.io/projected/0ff58320-29b7-4e49-a44a-5b9ec7727dcc-kube-api-access-ddw48\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:58.147671 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.147583 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" event={"ID":"0ff58320-29b7-4e49-a44a-5b9ec7727dcc","Type":"ContainerDied","Data":"1bf1a1eabfb5bb31165b96d725a5921f2a97b0b03a4adfd3b913d0d4b95e63ec"} Jun 02 02:53:58.147671 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.147611 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6" Jun 02 02:53:58.147671 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.147619 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bf1a1eabfb5bb31165b96d725a5921f2a97b0b03a4adfd3b913d0d4b95e63ec" Jun 02 02:53:58.149535 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.149509 2577 generic.go:358] "Generic (PLEG): container finished" podID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerID="c07b16e9ceee9b30f924a5c0f8515a25123e7b908aa8c787efc3db752bf38fb7" exitCode=0 Jun 02 02:53:58.149657 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.149588 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" event={"ID":"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd","Type":"ContainerDied","Data":"c07b16e9ceee9b30f924a5c0f8515a25123e7b908aa8c787efc3db752bf38fb7"} Jun 02 02:53:58.151137 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.151109 2577 generic.go:358] "Generic (PLEG): container finished" podID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerID="c77c3126737e3dbf107b9c962a961416143979d164c62ccd059beb383a8cda9b" exitCode=0 Jun 02 02:53:58.151258 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.151201 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" event={"ID":"b58ce261-7558-48df-ab1b-1e4586d0778d","Type":"ContainerDied","Data":"c77c3126737e3dbf107b9c962a961416143979d164c62ccd059beb383a8cda9b"} Jun 02 02:53:58.283612 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.283591 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:58.367725 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.367696 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-util\") pod \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " Jun 02 02:53:58.367890 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.367786 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-bundle\") pod \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " Jun 02 02:53:58.367890 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.367830 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvn7j\" (UniqueName: \"kubernetes.io/projected/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-kube-api-access-rvn7j\") pod \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\" (UID: \"e05875ee-7296-4bbb-a110-7d5c2c9ae81d\") " Jun 02 02:53:58.368372 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.368347 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-bundle" (OuterVolumeSpecName: "bundle") pod "e05875ee-7296-4bbb-a110-7d5c2c9ae81d" (UID: "e05875ee-7296-4bbb-a110-7d5c2c9ae81d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:53:58.369908 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.369882 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-kube-api-access-rvn7j" (OuterVolumeSpecName: "kube-api-access-rvn7j") pod "e05875ee-7296-4bbb-a110-7d5c2c9ae81d" (UID: "e05875ee-7296-4bbb-a110-7d5c2c9ae81d"). InnerVolumeSpecName "kube-api-access-rvn7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:53:58.373033 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.373014 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-util" (OuterVolumeSpecName: "util") pod "e05875ee-7296-4bbb-a110-7d5c2c9ae81d" (UID: "e05875ee-7296-4bbb-a110-7d5c2c9ae81d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:53:58.469019 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.468992 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:58.469019 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.469018 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvn7j\" (UniqueName: \"kubernetes.io/projected/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-kube-api-access-rvn7j\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:58.469182 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:58.469027 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e05875ee-7296-4bbb-a110-7d5c2c9ae81d-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:59.156163 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.156123 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" event={"ID":"e05875ee-7296-4bbb-a110-7d5c2c9ae81d","Type":"ContainerDied","Data":"6fd6abca388c1dd8b568ab5c76622ba18619748dfc2bf8d15cc7c373fdc8de4a"} Jun 02 02:53:59.156163 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.156169 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fd6abca388c1dd8b568ab5c76622ba18619748dfc2bf8d15cc7c373fdc8de4a" Jun 02 02:53:59.156707 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.156139 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl" Jun 02 02:53:59.158200 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.158163 2577 generic.go:358] "Generic (PLEG): container finished" podID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerID="fecdb68672b4975ce9696de686a4b05a31d6a898f79807bbfb18c8242fba9c9f" exitCode=0 Jun 02 02:53:59.158393 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.158246 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" event={"ID":"b58ce261-7558-48df-ab1b-1e4586d0778d","Type":"ContainerDied","Data":"fecdb68672b4975ce9696de686a4b05a31d6a898f79807bbfb18c8242fba9c9f"} Jun 02 02:53:59.287557 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.287536 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:53:59.376739 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.376708 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-bundle\") pod \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " Jun 02 02:53:59.376739 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.376745 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-util\") pod \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " Jun 02 02:53:59.376986 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.376783 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ckns\" (UniqueName: \"kubernetes.io/projected/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-kube-api-access-2ckns\") pod \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\" (UID: \"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd\") " Jun 02 02:53:59.377282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.377259 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-bundle" (OuterVolumeSpecName: "bundle") pod "dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" (UID: "dc649ba0-846c-4ec3-8d2d-f81736b7c6fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:53:59.379033 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.379011 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-kube-api-access-2ckns" (OuterVolumeSpecName: "kube-api-access-2ckns") pod "dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" (UID: "dc649ba0-846c-4ec3-8d2d-f81736b7c6fd"). InnerVolumeSpecName "kube-api-access-2ckns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:53:59.381667 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.381645 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-util" (OuterVolumeSpecName: "util") pod "dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" (UID: "dc649ba0-846c-4ec3-8d2d-f81736b7c6fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:53:59.477664 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.477632 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:59.477664 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.477661 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:53:59.477854 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:53:59.477671 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ckns\" (UniqueName: \"kubernetes.io/projected/dc649ba0-846c-4ec3-8d2d-f81736b7c6fd-kube-api-access-2ckns\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:00.163879 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.163824 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" Jun 02 02:54:00.163879 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.163843 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn" event={"ID":"dc649ba0-846c-4ec3-8d2d-f81736b7c6fd","Type":"ContainerDied","Data":"43bca4c7845c658b1f839497141f272dd85a39e6da76e109124cc84904063b8d"} Jun 02 02:54:00.164349 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.163896 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43bca4c7845c658b1f839497141f272dd85a39e6da76e109124cc84904063b8d" Jun 02 02:54:00.299150 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.299129 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:54:00.384667 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.384636 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7llt\" (UniqueName: \"kubernetes.io/projected/b58ce261-7558-48df-ab1b-1e4586d0778d-kube-api-access-f7llt\") pod \"b58ce261-7558-48df-ab1b-1e4586d0778d\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " Jun 02 02:54:00.384827 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.384719 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-bundle\") pod \"b58ce261-7558-48df-ab1b-1e4586d0778d\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " Jun 02 02:54:00.384827 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.384744 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-util\") pod \"b58ce261-7558-48df-ab1b-1e4586d0778d\" (UID: \"b58ce261-7558-48df-ab1b-1e4586d0778d\") " Jun 02 02:54:00.385217 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.385189 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-bundle" (OuterVolumeSpecName: "bundle") pod "b58ce261-7558-48df-ab1b-1e4586d0778d" (UID: "b58ce261-7558-48df-ab1b-1e4586d0778d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:54:00.387011 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.386958 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58ce261-7558-48df-ab1b-1e4586d0778d-kube-api-access-f7llt" (OuterVolumeSpecName: "kube-api-access-f7llt") pod "b58ce261-7558-48df-ab1b-1e4586d0778d" (UID: "b58ce261-7558-48df-ab1b-1e4586d0778d"). InnerVolumeSpecName "kube-api-access-f7llt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:54:00.392084 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.392056 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-util" (OuterVolumeSpecName: "util") pod "b58ce261-7558-48df-ab1b-1e4586d0778d" (UID: "b58ce261-7558-48df-ab1b-1e4586d0778d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:54:00.486333 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.486295 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:00.486333 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.486325 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b58ce261-7558-48df-ab1b-1e4586d0778d-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:00.486333 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:00.486337 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7llt\" (UniqueName: \"kubernetes.io/projected/b58ce261-7558-48df-ab1b-1e4586d0778d-kube-api-access-f7llt\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:01.169541 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:01.169501 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" event={"ID":"b58ce261-7558-48df-ab1b-1e4586d0778d","Type":"ContainerDied","Data":"a32977a703fdfe9eddffdb89ed68485b19b27557c83d7fb43f01ce18d2f2b7ee"} Jun 02 02:54:01.169541 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:01.169521 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc" Jun 02 02:54:01.169541 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:01.169537 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a32977a703fdfe9eddffdb89ed68485b19b27557c83d7fb43f01ce18d2f2b7ee" Jun 02 02:54:18.896053 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.895961 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp"] Jun 02 02:54:18.896691 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896667 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerName="util" Jun 02 02:54:18.896790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896694 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerName="util" Jun 02 02:54:18.896790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896708 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerName="extract" Jun 02 02:54:18.896790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896717 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerName="extract" Jun 02 02:54:18.896790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896752 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerName="extract" Jun 02 02:54:18.896790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896767 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerName="extract" Jun 02 02:54:18.896790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896782 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerName="pull" Jun 02 02:54:18.896790 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896791 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerName="pull" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896810 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerName="util" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896818 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerName="util" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896828 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerName="util" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896837 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerName="util" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896875 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerName="pull" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896884 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerName="pull" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896900 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerName="pull" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896908 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerName="pull" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896924 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerName="extract" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896932 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerName="extract" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896945 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerName="pull" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896953 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerName="pull" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896963 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerName="util" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896973 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerName="util" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.896992 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerName="extract" Jun 02 02:54:18.897120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.897000 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerName="extract" Jun 02 02:54:18.897816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.897166 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="b58ce261-7558-48df-ab1b-1e4586d0778d" containerName="extract" Jun 02 02:54:18.897816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.897188 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ff58320-29b7-4e49-a44a-5b9ec7727dcc" containerName="extract" Jun 02 02:54:18.897816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.897201 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc649ba0-846c-4ec3-8d2d-f81736b7c6fd" containerName="extract" Jun 02 02:54:18.897816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.897219 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="e05875ee-7296-4bbb-a110-7d5c2c9ae81d" containerName="extract" Jun 02 02:54:18.902537 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.902515 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:18.905447 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.905424 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 02:54:18.906351 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.906319 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 02:54:18.906921 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.906898 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zwlmp\"" Jun 02 02:54:18.908433 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:18.908412 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp"] Jun 02 02:54:19.044758 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:19.044728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpm4\" (UniqueName: \"kubernetes.io/projected/6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e-kube-api-access-jhpm4\") pod \"limitador-operator-controller-manager-85c4996f8c-65xkp\" (UID: \"6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:19.146132 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:19.146057 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpm4\" (UniqueName: \"kubernetes.io/projected/6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e-kube-api-access-jhpm4\") pod \"limitador-operator-controller-manager-85c4996f8c-65xkp\" (UID: \"6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:19.155260 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:19.155231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpm4\" (UniqueName: \"kubernetes.io/projected/6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e-kube-api-access-jhpm4\") pod \"limitador-operator-controller-manager-85c4996f8c-65xkp\" (UID: \"6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:19.215175 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:19.215151 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:19.353405 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:19.353341 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp"] Jun 02 02:54:19.355933 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:54:19.355903 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc3cd1c_6e89_49bd_8bd3_8c58ec50716e.slice/crio-8a870a29181f412bd639e2b59eed33a1750ca78c58b3ef2560bb81e67c698bda WatchSource:0}: Error finding container 8a870a29181f412bd639e2b59eed33a1750ca78c58b3ef2560bb81e67c698bda: Status 404 returned error can't find the container with id 8a870a29181f412bd639e2b59eed33a1750ca78c58b3ef2560bb81e67c698bda Jun 02 02:54:20.246030 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.245981 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" event={"ID":"6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e","Type":"ContainerStarted","Data":"8a870a29181f412bd639e2b59eed33a1750ca78c58b3ef2560bb81e67c698bda"} Jun 02 02:54:20.394653 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.394617 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-796c74c885-bvhlm" podUID="5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" containerName="console" containerID="cri-o://26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c" gracePeriod=15 Jun 02 02:54:20.644972 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.644950 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-796c74c885-bvhlm_5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa/console/0.log" Jun 02 02:54:20.645089 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.645011 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:54:20.763104 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763017 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-serving-cert\") pod \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " Jun 02 02:54:20.763282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763103 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-trusted-ca-bundle\") pod \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " Jun 02 02:54:20.763282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763131 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-service-ca\") pod \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " Jun 02 02:54:20.763282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763189 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d559\" (UniqueName: \"kubernetes.io/projected/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-kube-api-access-8d559\") pod \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " Jun 02 02:54:20.763282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763245 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-config\") pod \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " Jun 02 02:54:20.763282 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763273 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-oauth-serving-cert\") pod \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " Jun 02 02:54:20.763549 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763297 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-oauth-config\") pod \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\" (UID: \"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa\") " Jun 02 02:54:20.763659 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763633 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" (UID: "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:54:20.764254 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.763888 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" (UID: "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:54:20.764254 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.764048 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-config" (OuterVolumeSpecName: "console-config") pod "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" (UID: "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:54:20.764254 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.764214 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" (UID: "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:54:20.766005 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.765971 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" (UID: "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:54:20.766132 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.766069 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-kube-api-access-8d559" (OuterVolumeSpecName: "kube-api-access-8d559") pod "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" (UID: "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa"). InnerVolumeSpecName "kube-api-access-8d559". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:54:20.766252 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.766230 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" (UID: "5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:54:20.864281 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.864246 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-config\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:20.864281 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.864279 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-oauth-serving-cert\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:20.864496 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.864296 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-oauth-config\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:20.864496 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.864312 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-console-serving-cert\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:20.864496 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.864326 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-trusted-ca-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:20.864496 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.864337 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-service-ca\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:20.864496 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:20.864346 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d559\" (UniqueName: \"kubernetes.io/projected/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa-kube-api-access-8d559\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:21.251379 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.251351 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-796c74c885-bvhlm_5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa/console/0.log" Jun 02 02:54:21.251833 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.251395 2577 generic.go:358] "Generic (PLEG): container finished" podID="5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" containerID="26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c" exitCode=2 Jun 02 02:54:21.251833 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.251467 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796c74c885-bvhlm" Jun 02 02:54:21.251833 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.251483 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796c74c885-bvhlm" event={"ID":"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa","Type":"ContainerDied","Data":"26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c"} Jun 02 02:54:21.251833 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.251529 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796c74c885-bvhlm" event={"ID":"5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa","Type":"ContainerDied","Data":"3724931c5673e787098e098fb308b460a9c4789bf7559a5307f5d94345d5b751"} Jun 02 02:54:21.251833 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.251550 2577 scope.go:117] "RemoveContainer" containerID="26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c" Jun 02 02:54:21.253248 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.253218 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" event={"ID":"6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e","Type":"ContainerStarted","Data":"5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d"} Jun 02 02:54:21.253374 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.253324 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:21.260769 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.260751 2577 scope.go:117] "RemoveContainer" containerID="26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c" Jun 02 02:54:21.261054 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:54:21.261036 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c\": container with ID starting with 26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c not found: ID does not exist" containerID="26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c" Jun 02 02:54:21.261106 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.261062 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c"} err="failed to get container status \"26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c\": rpc error: code = NotFound desc = could not find container \"26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c\": container with ID starting with 26b5936a9159a2b3212fec996f2e42c21916eb1f7cd25d34e43701dd90faad3c not found: ID does not exist" Jun 02 02:54:21.280621 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.280578 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" podStartSLOduration=1.492442625 podStartE2EDuration="3.280563762s" podCreationTimestamp="2026-06-02 02:54:18 +0000 UTC" firstStartedPulling="2026-06-02 02:54:19.358288091 +0000 UTC m=+535.450822387" lastFinishedPulling="2026-06-02 02:54:21.146409224 +0000 UTC m=+537.238943524" observedRunningTime="2026-06-02 02:54:21.279767255 +0000 UTC m=+537.372301583" watchObservedRunningTime="2026-06-02 02:54:21.280563762 +0000 UTC m=+537.373098079" Jun 02 02:54:21.298557 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.298529 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-796c74c885-bvhlm"] Jun 02 02:54:21.306543 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:21.306504 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-796c74c885-bvhlm"] Jun 02 02:54:22.445472 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:22.445439 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" path="/var/lib/kubelet/pods/5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa/volumes" Jun 02 02:54:32.260672 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:32.260641 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:34.278552 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.278516 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp"] Jun 02 02:54:34.278971 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.278726 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" podUID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" containerName="manager" containerID="cri-o://5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d" gracePeriod=2 Jun 02 02:54:34.286831 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.286803 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp"] Jun 02 02:54:34.309798 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.309765 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m"] Jun 02 02:54:34.310151 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.310137 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" containerName="console" Jun 02 02:54:34.310211 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.310153 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" containerName="console" Jun 02 02:54:34.310211 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.310162 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" containerName="manager" Jun 02 02:54:34.310211 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.310168 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" containerName="manager" Jun 02 02:54:34.310303 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.310240 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" containerName="manager" Jun 02 02:54:34.310303 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.310247 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f4e097f-ae1b-47cd-8e0b-e6c514bbd6fa" containerName="console" Jun 02 02:54:34.313249 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.313232 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" Jun 02 02:54:34.315727 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.315705 2577 status_manager.go:895] "Failed to get status for pod" podUID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" err="pods \"limitador-operator-controller-manager-85c4996f8c-65xkp\" is forbidden: User \"system:node:ip-10-0-139-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-87.ec2.internal' and this object" Jun 02 02:54:34.325789 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.325763 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m"] Jun 02 02:54:34.370157 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.370129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcqfr\" (UniqueName: \"kubernetes.io/projected/6905e010-5e3d-480c-ac14-554039422f9c-kube-api-access-fcqfr\") pod \"limitador-operator-controller-manager-85c4996f8c-zgv8m\" (UID: \"6905e010-5e3d-480c-ac14-554039422f9c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" Jun 02 02:54:34.447309 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.447227 2577 status_manager.go:895] "Failed to get status for pod" podUID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" err="pods \"limitador-operator-controller-manager-85c4996f8c-65xkp\" is forbidden: User \"system:node:ip-10-0-139-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-87.ec2.internal' and this object" Jun 02 02:54:34.471602 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.471572 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqfr\" (UniqueName: \"kubernetes.io/projected/6905e010-5e3d-480c-ac14-554039422f9c-kube-api-access-fcqfr\") pod \"limitador-operator-controller-manager-85c4996f8c-zgv8m\" (UID: \"6905e010-5e3d-480c-ac14-554039422f9c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" Jun 02 02:54:34.485666 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.485640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcqfr\" (UniqueName: \"kubernetes.io/projected/6905e010-5e3d-480c-ac14-554039422f9c-kube-api-access-fcqfr\") pod \"limitador-operator-controller-manager-85c4996f8c-zgv8m\" (UID: \"6905e010-5e3d-480c-ac14-554039422f9c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" Jun 02 02:54:34.517331 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.517297 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:34.572939 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.572882 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhpm4\" (UniqueName: \"kubernetes.io/projected/6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e-kube-api-access-jhpm4\") pod \"6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e\" (UID: \"6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e\") " Jun 02 02:54:34.574761 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.574739 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e-kube-api-access-jhpm4" (OuterVolumeSpecName: "kube-api-access-jhpm4") pod "6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" (UID: "6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e"). InnerVolumeSpecName "kube-api-access-jhpm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:54:34.659943 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.659917 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" Jun 02 02:54:34.673960 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.673933 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhpm4\" (UniqueName: \"kubernetes.io/projected/6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e-kube-api-access-jhpm4\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:54:34.799333 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:34.799307 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m"] Jun 02 02:54:34.800824 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:54:34.800797 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6905e010_5e3d_480c_ac14_554039422f9c.slice/crio-3b9bd7fe2c94ffbd6e5bf8df5552374877b41f6a03f67b950fb510ff79b5fba2 WatchSource:0}: Error finding container 3b9bd7fe2c94ffbd6e5bf8df5552374877b41f6a03f67b950fb510ff79b5fba2: Status 404 returned error can't find the container with id 3b9bd7fe2c94ffbd6e5bf8df5552374877b41f6a03f67b950fb510ff79b5fba2 Jun 02 02:54:35.316460 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.316423 2577 generic.go:358] "Generic (PLEG): container finished" podID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" containerID="5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d" exitCode=0 Jun 02 02:54:35.317219 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.316475 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-65xkp" Jun 02 02:54:35.317219 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.316526 2577 scope.go:117] "RemoveContainer" containerID="5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d" Jun 02 02:54:35.318061 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.318037 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" event={"ID":"6905e010-5e3d-480c-ac14-554039422f9c","Type":"ContainerStarted","Data":"78e33a8ef824407b2f22aa30f4a0d6e8ff65da79e29a2c83fee45cce3b4393a5"} Jun 02 02:54:35.318166 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.318067 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" event={"ID":"6905e010-5e3d-480c-ac14-554039422f9c","Type":"ContainerStarted","Data":"3b9bd7fe2c94ffbd6e5bf8df5552374877b41f6a03f67b950fb510ff79b5fba2"} Jun 02 02:54:35.318166 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.318105 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" Jun 02 02:54:35.326385 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.326369 2577 scope.go:117] "RemoveContainer" containerID="5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d" Jun 02 02:54:35.326628 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:54:35.326611 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d\": container with ID starting with 5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d not found: ID does not exist" containerID="5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d" Jun 02 02:54:35.326673 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.326635 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d"} err="failed to get container status \"5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d\": rpc error: code = NotFound desc = could not find container \"5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d\": container with ID starting with 5f75bf11e32f12dd38bbffe65f2c7234289b7d1dc33ca0d5d557f4479c98005d not found: ID does not exist" Jun 02 02:54:35.336998 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:35.336956 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" podStartSLOduration=1.3369441229999999 podStartE2EDuration="1.336944123s" podCreationTimestamp="2026-06-02 02:54:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:54:35.334953007 +0000 UTC m=+551.427487352" watchObservedRunningTime="2026-06-02 02:54:35.336944123 +0000 UTC m=+551.429478441" Jun 02 02:54:36.444992 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:36.444952 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e" path="/var/lib/kubelet/pods/6bc3cd1c-6e89-49bd-8bd3-8c58ec50716e/volumes" Jun 02 02:54:46.325362 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:54:46.325331 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zgv8m" Jun 02 02:55:16.416809 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.416775 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ltkqb"] Jun 02 02:55:16.420344 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.420315 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.422851 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.422825 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 02:55:16.423203 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.423183 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mcdtr\"" Jun 02 02:55:16.428915 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.428893 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ltkqb"] Jun 02 02:55:16.440951 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.440922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bclgw\" (UniqueName: \"kubernetes.io/projected/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-kube-api-access-bclgw\") pod \"limitador-limitador-7d549b5b-ltkqb\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.441073 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.440979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-config-file\") pod \"limitador-limitador-7d549b5b-ltkqb\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.519222 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.519188 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ltkqb"] Jun 02 02:55:16.541844 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.541816 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-config-file\") pod \"limitador-limitador-7d549b5b-ltkqb\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.542058 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.541933 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bclgw\" (UniqueName: \"kubernetes.io/projected/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-kube-api-access-bclgw\") pod \"limitador-limitador-7d549b5b-ltkqb\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.542651 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.542622 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-config-file\") pod \"limitador-limitador-7d549b5b-ltkqb\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.549587 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.549561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bclgw\" (UniqueName: \"kubernetes.io/projected/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-kube-api-access-bclgw\") pod \"limitador-limitador-7d549b5b-ltkqb\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.732142 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.732111 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:16.861707 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:16.861682 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ltkqb"] Jun 02 02:55:16.864747 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:55:16.864720 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7ffdcb_76bf_42dd_b8ff_541aa0629779.slice/crio-00db50bf73ab2639dd626f241633ea2fcfe92e6a2eb8f9cd730342df0082119e WatchSource:0}: Error finding container 00db50bf73ab2639dd626f241633ea2fcfe92e6a2eb8f9cd730342df0082119e: Status 404 returned error can't find the container with id 00db50bf73ab2639dd626f241633ea2fcfe92e6a2eb8f9cd730342df0082119e Jun 02 02:55:17.479560 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:17.479527 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" event={"ID":"2a7ffdcb-76bf-42dd-b8ff-541aa0629779","Type":"ContainerStarted","Data":"00db50bf73ab2639dd626f241633ea2fcfe92e6a2eb8f9cd730342df0082119e"} Jun 02 02:55:20.492816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:20.492784 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" event={"ID":"2a7ffdcb-76bf-42dd-b8ff-541aa0629779","Type":"ContainerStarted","Data":"18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c"} Jun 02 02:55:20.493248 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:20.492848 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:20.509586 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:20.509543 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" podStartSLOduration=1.853403799 podStartE2EDuration="4.509531092s" podCreationTimestamp="2026-06-02 02:55:16 +0000 UTC" firstStartedPulling="2026-06-02 02:55:16.866592195 +0000 UTC m=+592.959126490" lastFinishedPulling="2026-06-02 02:55:19.522719481 +0000 UTC m=+595.615253783" observedRunningTime="2026-06-02 02:55:20.507407566 +0000 UTC m=+596.599941885" watchObservedRunningTime="2026-06-02 02:55:20.509531092 +0000 UTC m=+596.602065409" Jun 02 02:55:24.406983 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:24.406589 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:55:24.406983 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:24.406589 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 02:55:31.498570 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:31.498540 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:31.732989 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:31.732949 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ltkqb"] Jun 02 02:55:31.733231 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:31.733203 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" podUID="2a7ffdcb-76bf-42dd-b8ff-541aa0629779" containerName="limitador" containerID="cri-o://18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c" gracePeriod=30 Jun 02 02:55:32.280953 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.280928 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:32.374726 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.374649 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-config-file\") pod \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " Jun 02 02:55:32.374726 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.374695 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bclgw\" (UniqueName: \"kubernetes.io/projected/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-kube-api-access-bclgw\") pod \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\" (UID: \"2a7ffdcb-76bf-42dd-b8ff-541aa0629779\") " Jun 02 02:55:32.375013 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.374990 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-config-file" (OuterVolumeSpecName: "config-file") pod "2a7ffdcb-76bf-42dd-b8ff-541aa0629779" (UID: "2a7ffdcb-76bf-42dd-b8ff-541aa0629779"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:55:32.376679 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.376650 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-kube-api-access-bclgw" (OuterVolumeSpecName: "kube-api-access-bclgw") pod "2a7ffdcb-76bf-42dd-b8ff-541aa0629779" (UID: "2a7ffdcb-76bf-42dd-b8ff-541aa0629779"). InnerVolumeSpecName "kube-api-access-bclgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:55:32.475926 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.475898 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-config-file\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:55:32.475926 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.475922 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bclgw\" (UniqueName: \"kubernetes.io/projected/2a7ffdcb-76bf-42dd-b8ff-541aa0629779-kube-api-access-bclgw\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:55:32.538445 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.538417 2577 generic.go:358] "Generic (PLEG): container finished" podID="2a7ffdcb-76bf-42dd-b8ff-541aa0629779" containerID="18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c" exitCode=0 Jun 02 02:55:32.538814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.538475 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" Jun 02 02:55:32.538814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.538504 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" event={"ID":"2a7ffdcb-76bf-42dd-b8ff-541aa0629779","Type":"ContainerDied","Data":"18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c"} Jun 02 02:55:32.538814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.538540 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ltkqb" event={"ID":"2a7ffdcb-76bf-42dd-b8ff-541aa0629779","Type":"ContainerDied","Data":"00db50bf73ab2639dd626f241633ea2fcfe92e6a2eb8f9cd730342df0082119e"} Jun 02 02:55:32.538814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.538559 2577 scope.go:117] "RemoveContainer" containerID="18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c" Jun 02 02:55:32.546801 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.546785 2577 scope.go:117] "RemoveContainer" containerID="18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c" Jun 02 02:55:32.547058 ip-10-0-139-87 kubenswrapper[2577]: E0602 02:55:32.547041 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c\": container with ID starting with 18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c not found: ID does not exist" containerID="18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c" Jun 02 02:55:32.547121 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.547070 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c"} err="failed to get container status \"18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c\": rpc error: code = NotFound desc = could not find container \"18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c\": container with ID starting with 18b0eda609dc602b2dce716fd2106d93157445dae370e908fc7534bb46579b5c not found: ID does not exist" Jun 02 02:55:32.555390 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.555368 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ltkqb"] Jun 02 02:55:32.559584 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:32.559563 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ltkqb"] Jun 02 02:55:33.371024 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.370941 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-b7hlz"] Jun 02 02:55:33.371414 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.371391 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7ffdcb-76bf-42dd-b8ff-541aa0629779" containerName="limitador" Jun 02 02:55:33.371592 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.371575 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7ffdcb-76bf-42dd-b8ff-541aa0629779" containerName="limitador" Jun 02 02:55:33.371770 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.371750 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a7ffdcb-76bf-42dd-b8ff-541aa0629779" containerName="limitador" Jun 02 02:55:33.376082 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.376062 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.378816 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.378793 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 02:55:33.381572 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.381550 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-b7hlz"] Jun 02 02:55:33.485120 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.485079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/333b8589-df4d-41a0-bb6f-030b15cb1d49-data\") pod \"postgres-68c4fbbd6f-b7hlz\" (UID: \"333b8589-df4d-41a0-bb6f-030b15cb1d49\") " pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.485273 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.485156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65psv\" (UniqueName: \"kubernetes.io/projected/333b8589-df4d-41a0-bb6f-030b15cb1d49-kube-api-access-65psv\") pod \"postgres-68c4fbbd6f-b7hlz\" (UID: \"333b8589-df4d-41a0-bb6f-030b15cb1d49\") " pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.586473 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.586441 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/333b8589-df4d-41a0-bb6f-030b15cb1d49-data\") pod \"postgres-68c4fbbd6f-b7hlz\" (UID: \"333b8589-df4d-41a0-bb6f-030b15cb1d49\") " pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.586908 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.586502 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65psv\" (UniqueName: \"kubernetes.io/projected/333b8589-df4d-41a0-bb6f-030b15cb1d49-kube-api-access-65psv\") pod \"postgres-68c4fbbd6f-b7hlz\" (UID: \"333b8589-df4d-41a0-bb6f-030b15cb1d49\") " pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.586908 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.586802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/333b8589-df4d-41a0-bb6f-030b15cb1d49-data\") pod \"postgres-68c4fbbd6f-b7hlz\" (UID: \"333b8589-df4d-41a0-bb6f-030b15cb1d49\") " pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.594811 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.594792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65psv\" (UniqueName: \"kubernetes.io/projected/333b8589-df4d-41a0-bb6f-030b15cb1d49-kube-api-access-65psv\") pod \"postgres-68c4fbbd6f-b7hlz\" (UID: \"333b8589-df4d-41a0-bb6f-030b15cb1d49\") " pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.688997 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.688909 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:33.817490 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:33.817466 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-b7hlz"] Jun 02 02:55:33.819248 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:55:33.819212 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333b8589_df4d_41a0_bb6f_030b15cb1d49.slice/crio-f1525276400aa958b57377db8ce75bee811df80062f3b5f016c8c55f5866bbf4 WatchSource:0}: Error finding container f1525276400aa958b57377db8ce75bee811df80062f3b5f016c8c55f5866bbf4: Status 404 returned error can't find the container with id f1525276400aa958b57377db8ce75bee811df80062f3b5f016c8c55f5866bbf4 Jun 02 02:55:34.446096 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:34.446060 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a7ffdcb-76bf-42dd-b8ff-541aa0629779" path="/var/lib/kubelet/pods/2a7ffdcb-76bf-42dd-b8ff-541aa0629779/volumes" Jun 02 02:55:34.548215 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:34.548173 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-b7hlz" event={"ID":"333b8589-df4d-41a0-bb6f-030b15cb1d49","Type":"ContainerStarted","Data":"f1525276400aa958b57377db8ce75bee811df80062f3b5f016c8c55f5866bbf4"} Jun 02 02:55:36.557409 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:36.557374 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-b7hlz" event={"ID":"333b8589-df4d-41a0-bb6f-030b15cb1d49","Type":"ContainerStarted","Data":"be3c04d6568b961ea6c5c32c573008b1fed6b07388cb7629bf1a43db43c5c8e3"} Jun 02 02:55:36.557800 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:36.557440 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:36.574713 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:36.574664 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-b7hlz" podStartSLOduration=1.6843005629999999 podStartE2EDuration="3.574650082s" podCreationTimestamp="2026-06-02 02:55:33 +0000 UTC" firstStartedPulling="2026-06-02 02:55:33.820543055 +0000 UTC m=+609.913077351" lastFinishedPulling="2026-06-02 02:55:35.710892559 +0000 UTC m=+611.803426870" observedRunningTime="2026-06-02 02:55:36.572268093 +0000 UTC m=+612.664802414" watchObservedRunningTime="2026-06-02 02:55:36.574650082 +0000 UTC m=+612.667184400" Jun 02 02:55:42.591115 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:42.591086 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-b7hlz" Jun 02 02:55:44.400194 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.400163 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn"] Jun 02 02:55:44.406999 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.406978 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.409905 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.409683 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:55:44.410614 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.410591 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:55:44.410836 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.410820 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rr7ds\"" Jun 02 02:55:44.412414 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.412390 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn"] Jun 02 02:55:44.478809 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.478777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.479003 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.478815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsrtf\" (UniqueName: \"kubernetes.io/projected/bd565a80-84b0-4bcf-8c89-47f496ea0cec-kube-api-access-hsrtf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.479003 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.478842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.579982 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.579953 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.580141 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.579987 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsrtf\" (UniqueName: \"kubernetes.io/projected/bd565a80-84b0-4bcf-8c89-47f496ea0cec-kube-api-access-hsrtf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.580141 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.580010 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.580329 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.580312 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.580369 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.580346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.589568 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.589545 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsrtf\" (UniqueName: \"kubernetes.io/projected/bd565a80-84b0-4bcf-8c89-47f496ea0cec-kube-api-access-hsrtf\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.717613 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.717581 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:44.849384 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.849354 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn"] Jun 02 02:55:44.850872 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:55:44.850832 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd565a80_84b0_4bcf_8c89_47f496ea0cec.slice/crio-0b32082b8f86a62653bb969dfe429e09b40df2fd4db339504a9d5afd6d11b9c0 WatchSource:0}: Error finding container 0b32082b8f86a62653bb969dfe429e09b40df2fd4db339504a9d5afd6d11b9c0: Status 404 returned error can't find the container with id 0b32082b8f86a62653bb969dfe429e09b40df2fd4db339504a9d5afd6d11b9c0 Jun 02 02:55:44.853073 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:44.853056 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:55:45.592310 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:45.592277 2577 generic.go:358] "Generic (PLEG): container finished" podID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerID="a2ba93af3ec5de6eed6a8de6db7d4c4a4cedd885146dbf8e3b0e836873934f78" exitCode=0 Jun 02 02:55:45.592695 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:45.592346 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" event={"ID":"bd565a80-84b0-4bcf-8c89-47f496ea0cec","Type":"ContainerDied","Data":"a2ba93af3ec5de6eed6a8de6db7d4c4a4cedd885146dbf8e3b0e836873934f78"} Jun 02 02:55:45.592695 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:45.592377 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" event={"ID":"bd565a80-84b0-4bcf-8c89-47f496ea0cec","Type":"ContainerStarted","Data":"0b32082b8f86a62653bb969dfe429e09b40df2fd4db339504a9d5afd6d11b9c0"} Jun 02 02:55:46.597508 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:46.597426 2577 generic.go:358] "Generic (PLEG): container finished" podID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerID="0267ca1449551d29cce932ea567dd186712a613a4229463c004626de10c2196b" exitCode=0 Jun 02 02:55:46.597508 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:46.597476 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" event={"ID":"bd565a80-84b0-4bcf-8c89-47f496ea0cec","Type":"ContainerDied","Data":"0267ca1449551d29cce932ea567dd186712a613a4229463c004626de10c2196b"} Jun 02 02:55:47.603301 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:47.603265 2577 generic.go:358] "Generic (PLEG): container finished" podID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerID="c677ead728ad65fa8ccccf60309eb22785890df5dd1d0bfb8a3b481858f6f317" exitCode=0 Jun 02 02:55:47.603666 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:47.603330 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" event={"ID":"bd565a80-84b0-4bcf-8c89-47f496ea0cec","Type":"ContainerDied","Data":"c677ead728ad65fa8ccccf60309eb22785890df5dd1d0bfb8a3b481858f6f317"} Jun 02 02:55:48.736850 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.736822 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:48.811814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.811782 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-util\") pod \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " Jun 02 02:55:48.812017 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.811849 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsrtf\" (UniqueName: \"kubernetes.io/projected/bd565a80-84b0-4bcf-8c89-47f496ea0cec-kube-api-access-hsrtf\") pod \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " Jun 02 02:55:48.812017 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.812008 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-bundle\") pod \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\" (UID: \"bd565a80-84b0-4bcf-8c89-47f496ea0cec\") " Jun 02 02:55:48.812436 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.812405 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-bundle" (OuterVolumeSpecName: "bundle") pod "bd565a80-84b0-4bcf-8c89-47f496ea0cec" (UID: "bd565a80-84b0-4bcf-8c89-47f496ea0cec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:55:48.813854 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.813833 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd565a80-84b0-4bcf-8c89-47f496ea0cec-kube-api-access-hsrtf" (OuterVolumeSpecName: "kube-api-access-hsrtf") pod "bd565a80-84b0-4bcf-8c89-47f496ea0cec" (UID: "bd565a80-84b0-4bcf-8c89-47f496ea0cec"). InnerVolumeSpecName "kube-api-access-hsrtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:55:48.817318 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.817279 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-util" (OuterVolumeSpecName: "util") pod "bd565a80-84b0-4bcf-8c89-47f496ea0cec" (UID: "bd565a80-84b0-4bcf-8c89-47f496ea0cec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:55:48.913241 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.913175 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-util\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:55:48.913241 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.913200 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsrtf\" (UniqueName: \"kubernetes.io/projected/bd565a80-84b0-4bcf-8c89-47f496ea0cec-kube-api-access-hsrtf\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:55:48.913241 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:48.913210 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd565a80-84b0-4bcf-8c89-47f496ea0cec-bundle\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 02:55:49.612561 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:49.612528 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" event={"ID":"bd565a80-84b0-4bcf-8c89-47f496ea0cec","Type":"ContainerDied","Data":"0b32082b8f86a62653bb969dfe429e09b40df2fd4db339504a9d5afd6d11b9c0"} Jun 02 02:55:49.612561 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:49.612556 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70q5cqn" Jun 02 02:55:49.612561 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:49.612564 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b32082b8f86a62653bb969dfe429e09b40df2fd4db339504a9d5afd6d11b9c0" Jun 02 02:55:52.205105 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205070 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-dtxll"] Jun 02 02:55:52.205643 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205624 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerName="util" Jun 02 02:55:52.205731 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205646 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerName="util" Jun 02 02:55:52.205731 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205660 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerName="pull" Jun 02 02:55:52.205731 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205669 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerName="pull" Jun 02 02:55:52.205731 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205683 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerName="extract" Jun 02 02:55:52.205731 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205692 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerName="extract" Jun 02 02:55:52.206000 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.205776 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd565a80-84b0-4bcf-8c89-47f496ea0cec" containerName="extract" Jun 02 02:55:52.212237 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.212217 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" Jun 02 02:55:52.214814 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.214794 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-tj6pp\"" Jun 02 02:55:52.214940 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.214820 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 02:55:52.214940 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.214904 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 02:55:52.220946 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.220926 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-dtxll"] Jun 02 02:55:52.342785 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.342748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2dwk\" (UniqueName: \"kubernetes.io/projected/9ab8abf0-ec2b-478f-ac00-7682ec4663a3-kube-api-access-b2dwk\") pod \"keycloak-operator-7864d68cbd-dtxll\" (UID: \"9ab8abf0-ec2b-478f-ac00-7682ec4663a3\") " pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" Jun 02 02:55:52.443150 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.443120 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2dwk\" (UniqueName: \"kubernetes.io/projected/9ab8abf0-ec2b-478f-ac00-7682ec4663a3-kube-api-access-b2dwk\") pod \"keycloak-operator-7864d68cbd-dtxll\" (UID: \"9ab8abf0-ec2b-478f-ac00-7682ec4663a3\") " pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" Jun 02 02:55:52.452369 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.452343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2dwk\" (UniqueName: \"kubernetes.io/projected/9ab8abf0-ec2b-478f-ac00-7682ec4663a3-kube-api-access-b2dwk\") pod \"keycloak-operator-7864d68cbd-dtxll\" (UID: \"9ab8abf0-ec2b-478f-ac00-7682ec4663a3\") " pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" Jun 02 02:55:52.522936 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.522898 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" Jun 02 02:55:52.657771 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:52.657747 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-dtxll"] Jun 02 02:55:52.659218 ip-10-0-139-87 kubenswrapper[2577]: W0602 02:55:52.659194 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab8abf0_ec2b_478f_ac00_7682ec4663a3.slice/crio-d00511ae2f5fbe0119dd9d977442836524eddba4294dcd9b1d5edc508d4af1eb WatchSource:0}: Error finding container d00511ae2f5fbe0119dd9d977442836524eddba4294dcd9b1d5edc508d4af1eb: Status 404 returned error can't find the container with id d00511ae2f5fbe0119dd9d977442836524eddba4294dcd9b1d5edc508d4af1eb Jun 02 02:55:53.632793 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:53.632760 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" event={"ID":"9ab8abf0-ec2b-478f-ac00-7682ec4663a3","Type":"ContainerStarted","Data":"d00511ae2f5fbe0119dd9d977442836524eddba4294dcd9b1d5edc508d4af1eb"} Jun 02 02:55:59.662293 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:59.662252 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" event={"ID":"9ab8abf0-ec2b-478f-ac00-7682ec4663a3","Type":"ContainerStarted","Data":"a9514cddbb22115df8d6e09a4f9f630299d4a79e5e8e28926d0865d1ebfbf877"} Jun 02 02:55:59.679166 ip-10-0-139-87 kubenswrapper[2577]: I0602 02:55:59.679105 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-dtxll" podStartSLOduration=1.7224575880000002 podStartE2EDuration="7.679087184s" podCreationTimestamp="2026-06-02 02:55:52 +0000 UTC" firstStartedPulling="2026-06-02 02:55:52.660671695 +0000 UTC m=+628.753205991" lastFinishedPulling="2026-06-02 02:55:58.61730129 +0000 UTC m=+634.709835587" observedRunningTime="2026-06-02 02:55:59.678344447 +0000 UTC m=+635.770878766" watchObservedRunningTime="2026-06-02 02:55:59.679087184 +0000 UTC m=+635.771621505" Jun 02 03:00:00.140411 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.140378 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29672820-rfjr5"] Jun 02 03:00:00.143783 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.143766 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" Jun 02 03:00:00.146314 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.146290 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fmc8q\"" Jun 02 03:00:00.149701 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.149676 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29672820-rfjr5"] Jun 02 03:00:00.306197 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.306157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kgg4\" (UniqueName: \"kubernetes.io/projected/e92ece55-f286-4f7e-b11d-78cb4d4078da-kube-api-access-8kgg4\") pod \"maas-api-key-cleanup-29672820-rfjr5\" (UID: \"e92ece55-f286-4f7e-b11d-78cb4d4078da\") " pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" Jun 02 03:00:00.406976 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.406890 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kgg4\" (UniqueName: \"kubernetes.io/projected/e92ece55-f286-4f7e-b11d-78cb4d4078da-kube-api-access-8kgg4\") pod \"maas-api-key-cleanup-29672820-rfjr5\" (UID: \"e92ece55-f286-4f7e-b11d-78cb4d4078da\") " pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" Jun 02 03:00:00.414944 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.414919 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kgg4\" (UniqueName: \"kubernetes.io/projected/e92ece55-f286-4f7e-b11d-78cb4d4078da-kube-api-access-8kgg4\") pod \"maas-api-key-cleanup-29672820-rfjr5\" (UID: \"e92ece55-f286-4f7e-b11d-78cb4d4078da\") " pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" Jun 02 03:00:00.481386 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.481354 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" Jun 02 03:00:00.614112 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:00.614089 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29672820-rfjr5"] Jun 02 03:00:00.615683 ip-10-0-139-87 kubenswrapper[2577]: W0602 03:00:00.615659 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92ece55_f286_4f7e_b11d_78cb4d4078da.slice/crio-347c0a717e00ae8314f90182f716f6d47259bd254c6cf46f18f6adf332a9043b WatchSource:0}: Error finding container 347c0a717e00ae8314f90182f716f6d47259bd254c6cf46f18f6adf332a9043b: Status 404 returned error can't find the container with id 347c0a717e00ae8314f90182f716f6d47259bd254c6cf46f18f6adf332a9043b Jun 02 03:00:01.615762 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:01.615672 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" event={"ID":"e92ece55-f286-4f7e-b11d-78cb4d4078da","Type":"ContainerStarted","Data":"347c0a717e00ae8314f90182f716f6d47259bd254c6cf46f18f6adf332a9043b"} Jun 02 03:00:04.629931 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:04.629834 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" event={"ID":"e92ece55-f286-4f7e-b11d-78cb4d4078da","Type":"ContainerStarted","Data":"6f44d3e91627c44048f7e18f2158612829b2a39541cfa799e2b048b0c30d020b"} Jun 02 03:00:04.645424 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:04.645376 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" podStartSLOduration=1.226966416 podStartE2EDuration="4.645362327s" podCreationTimestamp="2026-06-02 03:00:00 +0000 UTC" firstStartedPulling="2026-06-02 03:00:00.617294507 +0000 UTC m=+876.709828816" lastFinishedPulling="2026-06-02 03:00:04.035690428 +0000 UTC m=+880.128224727" observedRunningTime="2026-06-02 03:00:04.643525284 +0000 UTC m=+880.736059602" watchObservedRunningTime="2026-06-02 03:00:04.645362327 +0000 UTC m=+880.737896647" Jun 02 03:00:05.635100 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:05.635068 2577 generic.go:358] "Generic (PLEG): container finished" podID="e92ece55-f286-4f7e-b11d-78cb4d4078da" containerID="6f44d3e91627c44048f7e18f2158612829b2a39541cfa799e2b048b0c30d020b" exitCode=0 Jun 02 03:00:05.635497 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:05.635162 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" event={"ID":"e92ece55-f286-4f7e-b11d-78cb4d4078da","Type":"ContainerDied","Data":"6f44d3e91627c44048f7e18f2158612829b2a39541cfa799e2b048b0c30d020b"} Jun 02 03:00:06.784665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:06.784643 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" Jun 02 03:00:06.964987 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:06.964958 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kgg4\" (UniqueName: \"kubernetes.io/projected/e92ece55-f286-4f7e-b11d-78cb4d4078da-kube-api-access-8kgg4\") pod \"e92ece55-f286-4f7e-b11d-78cb4d4078da\" (UID: \"e92ece55-f286-4f7e-b11d-78cb4d4078da\") " Jun 02 03:00:06.967091 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:06.967064 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92ece55-f286-4f7e-b11d-78cb4d4078da-kube-api-access-8kgg4" (OuterVolumeSpecName: "kube-api-access-8kgg4") pod "e92ece55-f286-4f7e-b11d-78cb4d4078da" (UID: "e92ece55-f286-4f7e-b11d-78cb4d4078da"). InnerVolumeSpecName "kube-api-access-8kgg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 03:00:07.065573 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:07.065536 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kgg4\" (UniqueName: \"kubernetes.io/projected/e92ece55-f286-4f7e-b11d-78cb4d4078da-kube-api-access-8kgg4\") on node \"ip-10-0-139-87.ec2.internal\" DevicePath \"\"" Jun 02 03:00:07.644003 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:07.643973 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" Jun 02 03:00:07.644003 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:07.643996 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672820-rfjr5" event={"ID":"e92ece55-f286-4f7e-b11d-78cb4d4078da","Type":"ContainerDied","Data":"347c0a717e00ae8314f90182f716f6d47259bd254c6cf46f18f6adf332a9043b"} Jun 02 03:00:07.644212 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:07.644025 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="347c0a717e00ae8314f90182f716f6d47259bd254c6cf46f18f6adf332a9043b" Jun 02 03:00:24.448591 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:24.448565 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 03:00:24.450595 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:00:24.450569 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 03:04:56.504554 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:56.504476 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d9fb5d8dc-nbphp_a5c2e52d-50a0-4718-81ef-e377fb1a5f63/nginx/0.log" Jun 02 03:04:56.754308 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:56.754280 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-mt226_7d5a3949-ae32-4bda-9816-6c8f44a0b91a/manager/0.log" Jun 02 03:04:56.868797 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:56.868722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-zlbpz_42e334c0-32d5-49d2-a3c9-a20129f9b5b3/manager/0.log" Jun 02 03:04:57.098172 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:57.098143 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29672820-rfjr5_e92ece55-f286-4f7e-b11d-78cb4d4078da/cleanup/0.log" Jun 02 03:04:57.340887 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:57.340837 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-6q8p2_c8eeddf4-e81a-4a11-9417-b381dba3d581/server/0.log" Jun 02 03:04:57.591619 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:57.591543 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8cc9fd78-ltf8z_336c62ff-d6b1-42da-947e-5a4909d4d89f/copy-manifests/0.log" Jun 02 03:04:57.605211 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:57.605190 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8cc9fd78-ltf8z_336c62ff-d6b1-42da-947e-5a4909d4d89f/manager/0.log" Jun 02 03:04:57.989724 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:57.989691 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-b7hlz_333b8589-df4d-41a0-bb6f-030b15cb1d49/postgres/0.log" Jun 02 03:04:58.777595 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:58.777567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc_b58ce261-7558-48df-ab1b-1e4586d0778d/util/0.log" Jun 02 03:04:58.787222 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:58.787196 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc_b58ce261-7558-48df-ab1b-1e4586d0778d/pull/0.log" Jun 02 03:04:58.793444 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:58.793411 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc_b58ce261-7558-48df-ab1b-1e4586d0778d/extract/0.log" Jun 02 03:04:58.905410 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:58.905383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn_dc649ba0-846c-4ec3-8d2d-f81736b7c6fd/util/0.log" Jun 02 03:04:58.912087 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:58.912068 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn_dc649ba0-846c-4ec3-8d2d-f81736b7c6fd/pull/0.log" Jun 02 03:04:58.918671 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:58.918654 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn_dc649ba0-846c-4ec3-8d2d-f81736b7c6fd/extract/0.log" Jun 02 03:04:59.034715 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:59.034653 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6_0ff58320-29b7-4e49-a44a-5b9ec7727dcc/util/0.log" Jun 02 03:04:59.041513 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:59.041494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6_0ff58320-29b7-4e49-a44a-5b9ec7727dcc/pull/0.log" Jun 02 03:04:59.050679 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:59.050661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6_0ff58320-29b7-4e49-a44a-5b9ec7727dcc/extract/0.log" Jun 02 03:04:59.164486 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:59.164453 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl_e05875ee-7296-4bbb-a110-7d5c2c9ae81d/util/0.log" Jun 02 03:04:59.172104 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:59.172079 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl_e05875ee-7296-4bbb-a110-7d5c2c9ae81d/pull/0.log" Jun 02 03:04:59.178632 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:04:59.178611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl_e05875ee-7296-4bbb-a110-7d5c2c9ae81d/extract/0.log" Jun 02 03:05:00.155562 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:00.155531 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zgv8m_6905e010-5e3d-480c-ac14-554039422f9c/manager/0.log" Jun 02 03:05:00.635596 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:00.635566 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mvcs8_37695f29-1db3-40af-9fdf-059f00fefea6/discovery/0.log" Jun 02 03:05:00.857818 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:00.857792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d86d5b57-zwwcv_2f355e56-2783-44d0-81ab-e01aa33d6278/kube-auth-proxy/0.log" Jun 02 03:05:01.244994 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:01.244969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58886f6fcf-jfhqq_90125e5f-aacc-4df5-9652-abdf545a10c5/router/0.log" Jun 02 03:05:09.647636 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:09.647609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6g89r_56f7dc6b-9956-4978-9bc2-661d9e8e87a8/global-pull-secret-syncer/0.log" Jun 02 03:05:09.866644 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:09.866614 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-226xq_ccb4fd09-dd0c-4d09-8d05-ff0c775360d9/konnectivity-agent/0.log" Jun 02 03:05:10.117659 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:10.117630 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-87.ec2.internal_f28e4ed091d830f86982f1afbe58a639/haproxy/0.log" Jun 02 03:05:13.379552 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.379519 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc_b58ce261-7558-48df-ab1b-1e4586d0778d/extract/0.log" Jun 02 03:05:13.417004 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.416977 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc_b58ce261-7558-48df-ab1b-1e4586d0778d/util/0.log" Jun 02 03:05:13.458407 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.458383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrbdc_b58ce261-7558-48df-ab1b-1e4586d0778d/pull/0.log" Jun 02 03:05:13.501241 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.501217 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn_dc649ba0-846c-4ec3-8d2d-f81736b7c6fd/extract/0.log" Jun 02 03:05:13.535416 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.535392 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn_dc649ba0-846c-4ec3-8d2d-f81736b7c6fd/util/0.log" Jun 02 03:05:13.578590 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.578571 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l8ttn_dc649ba0-846c-4ec3-8d2d-f81736b7c6fd/pull/0.log" Jun 02 03:05:13.638616 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.638557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6_0ff58320-29b7-4e49-a44a-5b9ec7727dcc/extract/0.log" Jun 02 03:05:13.671690 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.671668 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6_0ff58320-29b7-4e49-a44a-5b9ec7727dcc/util/0.log" Jun 02 03:05:13.700822 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.700801 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wz4d6_0ff58320-29b7-4e49-a44a-5b9ec7727dcc/pull/0.log" Jun 02 03:05:13.733314 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.733297 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl_e05875ee-7296-4bbb-a110-7d5c2c9ae81d/extract/0.log" Jun 02 03:05:13.758261 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.758243 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl_e05875ee-7296-4bbb-a110-7d5c2c9ae81d/util/0.log" Jun 02 03:05:13.787471 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:13.787449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c7gzl_e05875ee-7296-4bbb-a110-7d5c2c9ae81d/pull/0.log" Jun 02 03:05:14.206258 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:14.206225 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-zgv8m_6905e010-5e3d-480c-ac14-554039422f9c/manager/0.log" Jun 02 03:05:16.131733 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:16.131708 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-mrf8g_83730f9b-72e3-45f3-9cfd-64f8faa37ea6/cluster-monitoring-operator/0.log" Jun 02 03:05:16.330299 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:16.330273 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dd8b6f5f9-kmt58_e68a3451-b9bd-4db9-abec-678da55e2880/metrics-server/0.log" Jun 02 03:05:16.657882 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:16.657841 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl9xn_31c8a03f-1102-4643-90c3-47eab34acbe3/node-exporter/0.log" Jun 02 03:05:16.697983 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:16.697957 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl9xn_31c8a03f-1102-4643-90c3-47eab34acbe3/kube-rbac-proxy/0.log" Jun 02 03:05:16.761834 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:16.761807 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl9xn_31c8a03f-1102-4643-90c3-47eab34acbe3/init-textfile/0.log" Jun 02 03:05:17.273748 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:17.273719 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-hzjr7_34eff1e7-b87f-4395-a50e-a80acb03da35/prometheus-operator/0.log" Jun 02 03:05:17.309194 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:17.309171 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-hzjr7_34eff1e7-b87f-4395-a50e-a80acb03da35/kube-rbac-proxy/0.log" Jun 02 03:05:17.377775 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:17.377750 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cd7d4b67c-hlk8q_f558249d-8baf-4205-b0de-6d2346386497/telemeter-client/0.log" Jun 02 03:05:17.411157 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:17.411123 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cd7d4b67c-hlk8q_f558249d-8baf-4205-b0de-6d2346386497/reload/0.log" Jun 02 03:05:17.435713 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:17.435684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cd7d4b67c-hlk8q_f558249d-8baf-4205-b0de-6d2346386497/kube-rbac-proxy/0.log" Jun 02 03:05:18.788223 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.788190 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4"] Jun 02 03:05:18.788591 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.788561 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92ece55-f286-4f7e-b11d-78cb4d4078da" containerName="cleanup" Jun 02 03:05:18.788591 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.788572 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92ece55-f286-4f7e-b11d-78cb4d4078da" containerName="cleanup" Jun 02 03:05:18.788667 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.788653 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="e92ece55-f286-4f7e-b11d-78cb4d4078da" containerName="cleanup" Jun 02 03:05:18.791729 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.791713 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:18.794541 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.794520 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfk5k\"/\"openshift-service-ca.crt\"" Jun 02 03:05:18.794665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.794591 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sfk5k\"/\"default-dockercfg-8xdm6\"" Jun 02 03:05:18.796333 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.796311 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfk5k\"/\"kube-root-ca.crt\"" Jun 02 03:05:18.803718 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.803695 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4"] Jun 02 03:05:18.914559 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.914526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-lib-modules\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:18.914559 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.914560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmd29\" (UniqueName: \"kubernetes.io/projected/94c46c29-a043-430a-8436-fa8a2c9f13a1-kube-api-access-hmd29\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:18.914778 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.914596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-sys\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:18.914778 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.914637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-proc\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:18.914778 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:18.914663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-podres\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015415 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015381 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-lib-modules\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015415 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015415 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmd29\" (UniqueName: \"kubernetes.io/projected/94c46c29-a043-430a-8436-fa8a2c9f13a1-kube-api-access-hmd29\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015455 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-sys\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015482 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-proc\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015509 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-podres\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-lib-modules\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015577 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-sys\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-proc\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.015665 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.015631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/94c46c29-a043-430a-8436-fa8a2c9f13a1-podres\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.028975 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.028952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmd29\" (UniqueName: \"kubernetes.io/projected/94c46c29-a043-430a-8436-fa8a2c9f13a1-kube-api-access-hmd29\") pod \"perf-node-gather-daemonset-2kpg4\" (UID: \"94c46c29-a043-430a-8436-fa8a2c9f13a1\") " pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.102006 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.101921 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.237973 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.237943 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4"] Jun 02 03:05:19.239534 ip-10-0-139-87 kubenswrapper[2577]: W0602 03:05:19.239505 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod94c46c29_a043_430a_8436_fa8a2c9f13a1.slice/crio-ece41fb5c2252822b176e5706e52811fbac7866c732064539af3bd6f337f8291 WatchSource:0}: Error finding container ece41fb5c2252822b176e5706e52811fbac7866c732064539af3bd6f337f8291: Status 404 returned error can't find the container with id ece41fb5c2252822b176e5706e52811fbac7866c732064539af3bd6f337f8291 Jun 02 03:05:19.240984 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.240967 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 03:05:19.848195 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.848160 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" event={"ID":"94c46c29-a043-430a-8436-fa8a2c9f13a1","Type":"ContainerStarted","Data":"fdb2dee1729c6f41861e620fd9083b208188492c916886ee0ee80af9bef70990"} Jun 02 03:05:19.848195 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.848196 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" event={"ID":"94c46c29-a043-430a-8436-fa8a2c9f13a1","Type":"ContainerStarted","Data":"ece41fb5c2252822b176e5706e52811fbac7866c732064539af3bd6f337f8291"} Jun 02 03:05:19.848610 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.848257 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:19.880881 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:19.880816 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" podStartSLOduration=1.8808029560000001 podStartE2EDuration="1.880802956s" podCreationTimestamp="2026-06-02 03:05:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 03:05:19.879478493 +0000 UTC m=+1195.972012813" watchObservedRunningTime="2026-06-02 03:05:19.880802956 +0000 UTC m=+1195.973337274" Jun 02 03:05:20.666678 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:20.666655 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-w8q62_a2ed165b-9aaa-461e-a4e7-bb77be221b51/volume-data-source-validator/0.log" Jun 02 03:05:21.480958 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:21.480930 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2l84v_43efa475-b2df-4f80-a9ab-3621f4e6a393/dns/0.log" Jun 02 03:05:21.526609 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:21.526582 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2l84v_43efa475-b2df-4f80-a9ab-3621f4e6a393/kube-rbac-proxy/0.log" Jun 02 03:05:21.709800 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:21.709777 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fbr8w_bc5ff513-a73b-44c9-bc56-e36cd25812cf/dns-node-resolver/0.log" Jun 02 03:05:22.218481 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:22.218443 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bdbd5dcf6-dnkzn_e66ac56b-dc4d-4711-a2c1-19e31789d8b1/registry/0.log" Jun 02 03:05:22.291419 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:22.291381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s274b_bd57cd98-c9ce-409b-b22b-3f73fd9d9dfb/node-ca/0.log" Jun 02 03:05:23.219395 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:23.219351 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mvcs8_37695f29-1db3-40af-9fdf-059f00fefea6/discovery/0.log" Jun 02 03:05:23.269397 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:23.269370 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d86d5b57-zwwcv_2f355e56-2783-44d0-81ab-e01aa33d6278/kube-auth-proxy/0.log" Jun 02 03:05:23.393185 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:23.393154 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58886f6fcf-jfhqq_90125e5f-aacc-4df5-9652-abdf545a10c5/router/0.log" Jun 02 03:05:23.920822 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:23.920791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nd6nh_62adc8e6-67d7-4417-b182-8178137cce23/serve-healthcheck-canary/0.log" Jun 02 03:05:24.478990 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:24.478965 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 03:05:24.483358 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:24.483334 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pw6lq_2fd00cdc-f46d-41b8-b401-ade2e3585ca9/ovn-acl-logging/0.log" Jun 02 03:05:24.548272 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:24.548249 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrjsv_9d17f5f1-22b6-42aa-bceb-e20072a6a5af/kube-rbac-proxy/0.log" Jun 02 03:05:24.570245 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:24.570226 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrjsv_9d17f5f1-22b6-42aa-bceb-e20072a6a5af/exporter/0.log" Jun 02 03:05:24.592696 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:24.592676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrjsv_9d17f5f1-22b6-42aa-bceb-e20072a6a5af/extractor/0.log" Jun 02 03:05:25.861920 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:25.861896 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sfk5k/perf-node-gather-daemonset-2kpg4" Jun 02 03:05:26.703605 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:26.703576 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d9fb5d8dc-nbphp_a5c2e52d-50a0-4718-81ef-e377fb1a5f63/nginx/0.log" Jun 02 03:05:26.771356 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:26.771325 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-mt226_7d5a3949-ae32-4bda-9816-6c8f44a0b91a/manager/0.log" Jun 02 03:05:26.822564 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:26.822535 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-zlbpz_42e334c0-32d5-49d2-a3c9-a20129f9b5b3/manager/0.log" Jun 02 03:05:26.890620 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:26.890594 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29672820-rfjr5_e92ece55-f286-4f7e-b11d-78cb4d4078da/cleanup/0.log" Jun 02 03:05:26.956252 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:26.956184 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-6q8p2_c8eeddf4-e81a-4a11-9417-b381dba3d581/server/0.log" Jun 02 03:05:27.108298 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:27.108265 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8cc9fd78-ltf8z_336c62ff-d6b1-42da-947e-5a4909d4d89f/manager/0.log" Jun 02 03:05:27.150967 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:27.150940 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8cc9fd78-ltf8z_336c62ff-d6b1-42da-947e-5a4909d4d89f/copy-manifests/0.log" Jun 02 03:05:27.404444 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:27.404414 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-b7hlz_333b8589-df4d-41a0-bb6f-030b15cb1d49/postgres/0.log" Jun 02 03:05:36.006930 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:36.006903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt4vr_fbc63c29-97cc-47e3-bf26-130f852a9b5e/kube-multus-additional-cni-plugins/0.log" Jun 02 03:05:36.027466 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:36.027440 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt4vr_fbc63c29-97cc-47e3-bf26-130f852a9b5e/egress-router-binary-copy/0.log" Jun 02 03:05:36.048962 ip-10-0-139-87 kubenswrapper[2577]: I0602 03:05:36.048941 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt4vr_fbc63c29-97cc-47e3-bf26-130f852a9b5e/cni-plugins/0.log"