Jun 10 19:56:47.306140 ip-10-0-138-104 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 19:56:47.306154 ip-10-0-138-104 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 19:56:47.306164 ip-10-0-138-104 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 19:56:47.306387 ip-10-0-138-104 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 19:56:58.858098 ip-10-0-138-104 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 19:56:58.858112 ip-10-0-138-104 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 83042fc87202417c95b07d1b42400454 -- Jun 10 19:59:34.863799 ip-10-0-138-104 systemd[1]: Starting Kubernetes Kubelet... Jun 10 19:59:35.262497 ip-10-0-138-104 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 19:59:35.262497 ip-10-0-138-104 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 19:59:35.262497 ip-10-0-138-104 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 19:59:35.262497 ip-10-0-138-104 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 19:59:35.262497 ip-10-0-138-104 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 19:59:35.263754 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.263199 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 19:59:35.269811 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269791 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:59:35.269811 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269809 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:59:35.269811 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269814 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:59:35.269811 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269818 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269823 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269827 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269831 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269835 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269839 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269842 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269846 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269850 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269854 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269885 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269892 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269897 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269901 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269906 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269917 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269922 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269926 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269931 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:59:35.270066 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269938 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269944 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269949 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269955 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269960 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269965 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269969 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269973 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269978 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269982 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269986 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269990 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269994 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.269999 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270004 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270008 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270013 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270017 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270021 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270025 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:59:35.270860 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270030 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270035 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270039 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270043 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270048 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270052 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270056 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270060 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270064 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270069 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270073 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270077 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270081 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270085 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270089 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270094 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270099 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270104 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270108 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270112 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:59:35.271693 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270117 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270121 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270127 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270134 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270139 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270143 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270148 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270152 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270156 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270162 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270166 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270170 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270175 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270179 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270183 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270190 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270195 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270199 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270203 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270207 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:59:35.272578 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270212 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270217 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270221 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270226 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270230 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270234 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270238 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270244 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270249 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270253 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270257 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270261 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270267 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270273 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270278 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270282 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.270287 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271459 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271470 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:59:35.273435 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271475 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271479 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271484 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271489 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271494 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271499 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271503 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271527 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271532 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271536 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271541 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271545 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271551 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271555 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271559 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271563 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271568 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271572 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271576 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271580 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:59:35.274276 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271586 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271590 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271595 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271599 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271603 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271608 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271612 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271617 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271621 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271625 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271629 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271634 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271638 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271642 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271647 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271651 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271656 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271660 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271665 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271669 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:59:35.275018 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271673 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271679 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271684 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271688 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271694 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271698 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271702 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271706 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271711 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271715 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271719 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271723 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271727 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271732 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271736 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271740 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271744 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271749 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271753 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271757 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:59:35.275579 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271761 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271765 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271769 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271774 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271779 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271783 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271787 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271791 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271796 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271801 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271806 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271810 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271814 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271819 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271825 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271831 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271837 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271843 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:59:35.276182 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271849 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271855 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271860 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271864 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271868 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271873 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271877 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271882 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271886 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271890 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271895 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271899 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271903 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271907 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271912 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271916 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271920 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271924 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.271929 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272621 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:59:35.276810 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272631 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272636 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272640 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272646 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272651 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272655 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272660 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272664 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272668 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272673 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272677 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272681 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272686 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272690 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272694 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272698 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272703 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272707 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272711 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272715 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:59:35.277304 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272719 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272723 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272727 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272739 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272745 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272750 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272754 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272759 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272763 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272767 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272771 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272775 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272780 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272784 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272788 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272793 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272798 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272803 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272807 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:59:35.277976 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272811 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272815 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272820 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272824 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272828 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272832 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272838 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272842 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272846 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272850 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272855 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272859 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272863 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272867 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272872 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272876 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272881 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272886 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272892 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:59:35.278450 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272897 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272902 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272907 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272911 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272915 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272921 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272927 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272932 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272937 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272943 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272948 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272954 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272959 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272963 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272967 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272972 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272978 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272982 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272986 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:59:35.278956 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272990 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272995 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.272999 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273004 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273008 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273012 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273016 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273021 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273025 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273029 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273036 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273040 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273044 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273048 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273053 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273057 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273061 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273065 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273069 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273073 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.273078 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:59:35.279431 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273174 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273198 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273210 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273217 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273225 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273231 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273237 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273244 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273249 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273254 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273260 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273265 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273270 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273275 2578 flags.go:64] FLAG: --cgroup-root="" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273279 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273284 2578 flags.go:64] FLAG: --client-ca-file="" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273289 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273294 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273300 2578 flags.go:64] FLAG: --cluster-domain="" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273305 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273310 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273317 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273322 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273328 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 19:59:35.279989 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273333 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273338 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273344 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273348 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273353 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273357 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273362 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273367 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273377 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273388 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273392 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273397 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273402 2578 flags.go:64] FLAG: --enable-server="true" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273408 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273416 2578 flags.go:64] FLAG: --event-burst="100" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273421 2578 flags.go:64] FLAG: --event-qps="50" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273426 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273431 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273435 2578 flags.go:64] FLAG: --eviction-hard="" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273442 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273446 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273451 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273456 2578 flags.go:64] FLAG: --eviction-soft="" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273460 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273473 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 19:59:35.280631 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273479 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273484 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273489 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273494 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273499 2578 flags.go:64] FLAG: --feature-gates="" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273506 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273528 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273532 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273537 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273542 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273547 2578 flags.go:64] FLAG: --help="false" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273552 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273557 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273562 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273567 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273572 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273580 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273585 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273589 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273594 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273599 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273605 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273611 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273616 2578 flags.go:64] FLAG: --kube-reserved="" Jun 10 19:59:35.281255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273620 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273625 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273630 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273635 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273640 2578 flags.go:64] FLAG: --lock-file="" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273645 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273650 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273655 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273664 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273669 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273674 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273678 2578 flags.go:64] FLAG: --logging-format="text" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273683 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273689 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273694 2578 flags.go:64] FLAG: --manifest-url="" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273699 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273705 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273710 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273718 2578 flags.go:64] FLAG: --max-pods="110" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273723 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273728 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273732 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273737 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273742 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273749 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 19:59:35.281878 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273753 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273765 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273770 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273775 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273780 2578 flags.go:64] FLAG: --pod-cidr="" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273785 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273794 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273800 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273805 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273810 2578 flags.go:64] FLAG: --port="10250" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273815 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273820 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bb9ce11ad9634af3" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273825 2578 flags.go:64] FLAG: --qos-reserved="" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273830 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273834 2578 flags.go:64] FLAG: --register-node="true" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273839 2578 flags.go:64] FLAG: --register-with-taints="" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273845 2578 flags.go:64] FLAG: --registry-burst="10" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273850 2578 flags.go:64] FLAG: --registry-qps="5" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273855 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273859 2578 flags.go:64] FLAG: --reserved-memory="" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273866 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273871 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273876 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273881 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273886 2578 flags.go:64] FLAG: --runonce="false" Jun 10 19:59:35.282473 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273891 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273896 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273901 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273906 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273910 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273915 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273922 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273927 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273932 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273937 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273941 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273946 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273951 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273956 2578 flags.go:64] FLAG: --system-cgroups="" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273961 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273970 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273975 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273980 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273986 2578 flags.go:64] FLAG: --tls-min-version="" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273991 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.273995 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.274000 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.274004 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.274009 2578 flags.go:64] FLAG: --v="2" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.274016 2578 flags.go:64] FLAG: --version="false" Jun 10 19:59:35.283100 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.274022 2578 flags.go:64] FLAG: --vmodule="" Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.274028 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.274034 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274240 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274247 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274253 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274257 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274262 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274267 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274271 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274276 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274279 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274283 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274289 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274293 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274297 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274301 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274306 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274310 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274314 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:59:35.283745 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274319 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274332 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274337 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274341 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274347 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274352 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274356 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274361 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274365 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274369 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274374 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274378 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274382 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274388 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274393 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274397 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274402 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274406 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274411 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:59:35.284344 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274417 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274423 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274428 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274433 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274438 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274442 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274447 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274451 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274456 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274460 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274464 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274468 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274472 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274476 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274481 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274486 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274490 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274494 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274499 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274503 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:59:35.285038 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274523 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274528 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274532 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274537 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274541 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274545 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274552 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274556 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274560 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274565 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274569 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274573 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274577 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274581 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274586 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274590 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274594 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274598 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274603 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274607 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:59:35.285563 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274611 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274615 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274622 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274627 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274632 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274637 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274642 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274646 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274650 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274655 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274660 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274666 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274672 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274677 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274681 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274685 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274689 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274693 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274699 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:59:35.286047 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274704 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274708 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274712 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.274717 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.275412 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.282071 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.282086 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.282100 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.282106 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282160 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282165 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282169 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282172 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282176 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282179 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:59:35.286524 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282181 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282184 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282187 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282189 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282192 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282194 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282197 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282200 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282202 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282205 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282208 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282210 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282213 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282216 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282220 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282224 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282227 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282229 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282232 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:59:35.286971 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282235 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282239 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282242 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282245 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282248 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282251 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282254 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282257 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282260 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282262 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282265 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282267 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282270 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282273 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282275 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282278 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282281 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282283 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282286 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282288 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:59:35.287432 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282291 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282293 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282296 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282299 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282301 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282304 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282306 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282309 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282312 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282314 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282317 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282320 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282322 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282325 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282328 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282331 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282334 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282337 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282339 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282342 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:59:35.287948 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282345 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282347 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282350 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282353 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282355 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282358 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282360 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282363 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282366 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282369 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282373 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282376 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282379 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282382 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282384 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282387 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282389 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282392 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282394 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282397 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:59:35.288455 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282400 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282403 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282405 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282408 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282410 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282413 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282415 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282418 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282421 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282423 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282426 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282429 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282432 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282434 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.282439 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 19:59:35.289067 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282572 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282578 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282581 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282584 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282586 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282589 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282592 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282594 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282597 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282599 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282602 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282605 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282608 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282613 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282615 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282619 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282623 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282626 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282629 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 19:59:35.289487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282632 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282634 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282637 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282639 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282642 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282644 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282647 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282650 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282652 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282655 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282658 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282660 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282663 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282665 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282668 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282670 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282673 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282675 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282678 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282680 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 19:59:35.289970 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282683 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282685 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282688 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282690 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282693 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282695 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282697 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282700 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282702 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282705 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282707 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282710 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282712 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282715 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282717 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282720 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282723 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282725 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282728 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 19:59:35.290456 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282730 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282733 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282735 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282738 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282740 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282743 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282745 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282747 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282750 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282752 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282755 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282757 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282760 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282762 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282765 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282767 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282770 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282772 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282774 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282777 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 19:59:35.290927 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282779 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282782 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282784 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282787 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282789 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282792 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282795 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282797 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282800 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282802 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282806 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282809 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282812 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282815 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282818 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282820 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282823 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282826 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282828 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282830 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 19:59:35.291411 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:35.282833 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.282838 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.282943 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.286440 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.287949 2578 server.go:1019] "Starting client certificate rotation" Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.288050 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.288088 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.290376 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 19:59:35.291964 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.291461 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 19:59:35.304373 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.304353 2578 log.go:25] "Validated CRI v1 runtime API" Jun 10 19:59:35.307711 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.307682 2578 log.go:25] "Validated CRI v1 image API" Jun 10 19:59:35.308475 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.308458 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 19:59:35.310794 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.310770 2578 fs.go:135] Filesystem UUIDs: map[135e8323-abe6-4483-8ef9-7aa0bea662a0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dd7a4d80-dfb1-4fed-9e1d-a12d9cc66fa8:/dev/nvme0n1p4] Jun 10 19:59:35.310861 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.310794 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 19:59:35.315805 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.315687 2578 manager.go:216] Machine: {Timestamp:2026-06-10 19:59:35.314420835 +0000 UTC m=+0.335051057 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099695 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb0b6af8ca65b5cc262dacae43cb7 SystemUUID:ec2eb0b6-af8c-a65b-5cc2-62dacae43cb7 BootID:83042fc8-7202-417c-95b0-7d1b42400454 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:ac:1a:6c:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:ac:1a:6c:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:6c:ca:69:e3:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 19:59:35.315805 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.315798 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 19:59:35.315923 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.315907 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 19:59:35.317831 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.317816 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 19:59:35.319069 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.319044 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 19:59:35.319230 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.319074 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 19:59:35.320349 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.320338 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 19:59:35.320349 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.320349 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 19:59:35.320438 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.320356 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 19:59:35.321019 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.321009 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 19:59:35.321935 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.321926 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 19:59:35.325258 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.325247 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 10 19:59:35.325368 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.325359 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 19:59:35.325402 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.325387 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 10 19:59:35.325402 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.325401 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 19:59:35.325495 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.325413 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 19:59:35.325495 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.325430 2578 kubelet.go:398] "Adding apiserver pod source" Jun 10 19:59:35.325495 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.325445 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 19:59:35.326270 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.326248 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 19:59:35.326270 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.326271 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 19:59:35.329855 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.329820 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 19:59:35.331449 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.331435 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 19:59:35.331540 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.331465 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 19:59:35.332821 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332808 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332828 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332834 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332840 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332849 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332854 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332862 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332867 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 19:59:35.332874 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332873 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 19:59:35.333082 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332879 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 19:59:35.333082 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332888 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 19:59:35.333082 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.332893 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 19:59:35.333507 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.333497 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 19:59:35.333507 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.333506 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 19:59:35.336670 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.336654 2578 server.go:1268] "Started kubelet" Jun 10 19:59:35.336802 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.336753 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 19:59:35.336877 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.336859 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 19:59:35.336944 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.336872 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 19:59:35.336997 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.336959 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 19:59:35.337104 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.336748 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 19:59:35.337104 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.337085 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 19:59:35.337626 ip-10-0-138-104 systemd[1]: Started Kubernetes Kubelet. Jun 10 19:59:35.338801 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.338784 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 19:59:35.338801 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.338798 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 10 19:59:35.343416 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.343383 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 19:59:35.343997 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.343981 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 19:59:35.343997 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.343995 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 19:59:35.344147 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.344042 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:35.344728 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.344712 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 19:59:35.344868 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.344720 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 19:59:35.344960 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.344871 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 19:59:35.344960 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.344891 2578 factory.go:55] Registering systemd factory Jun 10 19:59:35.344960 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.344909 2578 factory.go:223] Registration of the systemd container factory successfully Jun 10 19:59:35.345094 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.344990 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 10 19:59:35.345094 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.345001 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 10 19:59:35.345181 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.345131 2578 factory.go:153] Registering CRI-O factory Jun 10 19:59:35.345181 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.345147 2578 factory.go:223] Registration of the crio container factory successfully Jun 10 19:59:35.345266 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.345198 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 19:59:35.345266 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.345222 2578 factory.go:103] Registering Raw factory Jun 10 19:59:35.345266 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.345237 2578 manager.go:1196] Started watching for new ooms in manager Jun 10 19:59:35.345786 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.344814 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-104.ec2.internal.18b7d0a2cfb93430 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-104.ec2.internal,UID:ip-10-0-138-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-104.ec2.internal,},FirstTimestamp:2026-06-10 19:59:35.336621104 +0000 UTC m=+0.357251327,LastTimestamp:2026-06-10 19:59:35.336621104 +0000 UTC m=+0.357251327,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-104.ec2.internal,}" Jun 10 19:59:35.346108 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.346091 2578 manager.go:349] Starting recovery of all containers Jun 10 19:59:35.349967 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.349943 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 19:59:35.349967 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.349952 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 19:59:35.359334 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.359317 2578 manager.go:354] Recovery completed Jun 10 19:59:35.362061 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.362042 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csfxq" Jun 10 19:59:35.363738 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.363726 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:59:35.366215 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.366200 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:59:35.366266 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.366233 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:59:35.366266 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.366248 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:59:35.366807 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.366791 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 19:59:35.366807 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.366801 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:59:35.366807 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.366805 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 19:59:35.366986 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.366824 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 10 19:59:35.367521 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.367498 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:59:35.367584 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.367554 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:59:35.367584 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.367564 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:59:35.368248 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.368139 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-104.ec2.internal.18b7d0a2d17cc768 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-104.ec2.internal,UID:ip-10-0-138-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-104.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-104.ec2.internal,},FirstTimestamp:2026-06-10 19:59:35.366215528 +0000 UTC m=+0.386845754,LastTimestamp:2026-06-10 19:59:35.366215528 +0000 UTC m=+0.386845754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-104.ec2.internal,}" Jun 10 19:59:35.368331 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.368282 2578 policy_none.go:49] "None policy: Start" Jun 10 19:59:35.368331 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.368300 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 19:59:35.368331 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.368314 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 19:59:35.369325 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.369310 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csfxq" Jun 10 19:59:35.370079 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.370066 2578 policy_none.go:47] "Start" Jun 10 19:59:35.401184 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.401166 2578 manager.go:337] "Starting Device Plugin manager" Jun 10 19:59:35.401269 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.401207 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 19:59:35.401269 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.401220 2578 server.go:87] "Starting device plugin registration server" Jun 10 19:59:35.401460 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.401445 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 19:59:35.401542 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.401463 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 19:59:35.401695 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.401679 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 19:59:35.401783 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.401772 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 19:59:35.401833 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.401784 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 19:59:35.402134 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.402119 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 19:59:35.402195 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.402168 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:35.417010 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.416977 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 19:59:35.422125 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.418177 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 19:59:35.422125 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.418245 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 19:59:35.422125 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.418270 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 19:59:35.422125 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.418361 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 19:59:35.422125 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.420417 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:59:35.501735 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.501692 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:59:35.505773 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.505753 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:59:35.505870 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.505785 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:59:35.505870 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.505797 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:59:35.505870 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.505824 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.515621 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.515570 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.515621 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.515591 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-104.ec2.internal\": node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:35.518600 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.518585 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"] Jun 10 19:59:35.518664 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.518643 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:59:35.520160 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.520133 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:59:35.520242 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.520168 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:59:35.520242 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.520179 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:59:35.521603 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.521592 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:59:35.521685 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.521671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.521734 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.521700 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:59:35.522300 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.522286 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:59:35.522374 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.522308 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:59:35.522374 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.522321 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:59:35.522374 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.522350 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:59:35.522525 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.522375 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:59:35.522525 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.522389 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:59:35.523959 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.523942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.524050 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.523979 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 19:59:35.524642 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.524628 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory" Jun 10 19:59:35.524740 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.524656 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 19:59:35.524740 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.524670 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID" Jun 10 19:59:35.533908 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.533890 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:35.538100 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.538079 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-104.ec2.internal\" not found" node="ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.541483 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.541463 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-104.ec2.internal\" not found" node="ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.634819 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.634786 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:35.646165 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.646131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/775f0be1eafb59e9bc4d24df466e4a75-config\") pod \"kube-apiserver-proxy-ip-10-0-138-104.ec2.internal\" (UID: \"775f0be1eafb59e9bc4d24df466e4a75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.646165 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.646163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02bf2e9816258b659dc9bb410fab8ee2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"02bf2e9816258b659dc9bb410fab8ee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.646294 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.646182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02bf2e9816258b659dc9bb410fab8ee2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"02bf2e9816258b659dc9bb410fab8ee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.735282 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.735243 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:35.746605 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.746583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/775f0be1eafb59e9bc4d24df466e4a75-config\") pod \"kube-apiserver-proxy-ip-10-0-138-104.ec2.internal\" (UID: \"775f0be1eafb59e9bc4d24df466e4a75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.746671 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.746610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02bf2e9816258b659dc9bb410fab8ee2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"02bf2e9816258b659dc9bb410fab8ee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.746671 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.746628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02bf2e9816258b659dc9bb410fab8ee2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"02bf2e9816258b659dc9bb410fab8ee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.746744 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.746669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/775f0be1eafb59e9bc4d24df466e4a75-config\") pod \"kube-apiserver-proxy-ip-10-0-138-104.ec2.internal\" (UID: \"775f0be1eafb59e9bc4d24df466e4a75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.746744 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.746689 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02bf2e9816258b659dc9bb410fab8ee2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"02bf2e9816258b659dc9bb410fab8ee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.746744 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.746669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02bf2e9816258b659dc9bb410fab8ee2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"02bf2e9816258b659dc9bb410fab8ee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.836066 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.835991 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:35.842165 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.842145 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.847329 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:35.847312 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:35.936475 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:35.936441 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:36.037035 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:36.037003 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:36.137570 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:36.137488 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:36.238293 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:36.238081 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:36.287882 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.287861 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 19:59:36.288391 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.288004 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 19:59:36.293731 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:36.293701 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bf2e9816258b659dc9bb410fab8ee2.slice/crio-f43675999a5f2ed2a83184be5c7508be86e8781c032d799c2924c5047583d054 WatchSource:0}: Error finding container f43675999a5f2ed2a83184be5c7508be86e8781c032d799c2924c5047583d054: Status 404 returned error can't find the container with id f43675999a5f2ed2a83184be5c7508be86e8781c032d799c2924c5047583d054 Jun 10 19:59:36.294313 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:36.293925 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775f0be1eafb59e9bc4d24df466e4a75.slice/crio-7f3a26bf4f5d5d202667753d24eddee42a605a3f8037bf73b36f6b6a3637f1c9 WatchSource:0}: Error finding container 7f3a26bf4f5d5d202667753d24eddee42a605a3f8037bf73b36f6b6a3637f1c9: Status 404 returned error can't find the container with id 7f3a26bf4f5d5d202667753d24eddee42a605a3f8037bf73b36f6b6a3637f1c9 Jun 10 19:59:36.298548 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.298536 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:59:36.338850 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:36.338832 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found" Jun 10 19:59:36.372169 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.372131 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 19:54:35 +0000 UTC" deadline="2027-12-15 19:56:51.667047233 +0000 UTC" Jun 10 19:59:36.372169 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.372170 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13271h57m15.294883207s" Jun 10 19:59:36.421617 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.421502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" event={"ID":"02bf2e9816258b659dc9bb410fab8ee2","Type":"ContainerStarted","Data":"f43675999a5f2ed2a83184be5c7508be86e8781c032d799c2924c5047583d054"} Jun 10 19:59:36.422397 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.422381 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" event={"ID":"775f0be1eafb59e9bc4d24df466e4a75","Type":"ContainerStarted","Data":"7f3a26bf4f5d5d202667753d24eddee42a605a3f8037bf73b36f6b6a3637f1c9"} Jun 10 19:59:36.436905 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.436884 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:59:36.444380 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.444363 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" Jun 10 19:59:36.455949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.455935 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 19:59:36.457686 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.457673 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" Jun 10 19:59:36.469018 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.469001 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 19:59:36.522896 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.522871 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:59:36.932260 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:36.932229 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:59:37.327543 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.327454 2578 apiserver.go:52] "Watching apiserver" Jun 10 19:59:37.335257 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.335233 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 19:59:37.336364 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.336334 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-bxscf","kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2lbwl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal","openshift-multus/network-metrics-daemon-mkwx6","openshift-network-diagnostics/network-check-target-j5t2c","openshift-network-operator/iptables-alerter-g2fpf","openshift-ovn-kubernetes/ovnkube-node-666mc","kube-system/global-pull-secret-syncer-l728l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp","openshift-dns/node-resolver-w7q6n","openshift-image-registry/node-ca-cvmnq","openshift-multus/multus-additional-cni-plugins-dx9lx","openshift-multus/multus-v6tcl"] Jun 10 19:59:37.337844 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.337819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.339034 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.339016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.340436 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.340230 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 19:59:37.340436 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.340240 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qn2mh\"" Jun 10 19:59:37.340436 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.340384 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 19:59:37.340677 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.340491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.340677 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.340565 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 19:59:37.340939 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.340923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5kdqz\"" Jun 10 19:59:37.341150 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.341124 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 19:59:37.341247 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.341158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 19:59:37.341247 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.341221 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 19:59:37.341449 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.341433 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 19:59:37.341543 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.341488 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 19:59:37.341763 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.341748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.342677 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.342658 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:59:37.342677 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.342670 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-49wwh\"" Jun 10 19:59:37.342847 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.342762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:37.342847 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.342819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:37.343033 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.343010 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 19:59:37.343666 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.343646 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 19:59:37.343821 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.343803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kjwng\"" Jun 10 19:59:37.344095 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.344080 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:37.344169 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.344143 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:37.344526 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.344500 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 19:59:37.345655 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.345637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.345747 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.345688 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:37.346969 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.346939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.348594 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.348575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.349308 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.349281 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 19:59:37.349408 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.349338 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:59:37.349656 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.349640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 19:59:37.349656 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.349649 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bw5qq\"" Jun 10 19:59:37.350202 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.350183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.350787 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.350766 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 19:59:37.350891 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.350798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 19:59:37.351014 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.350995 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 19:59:37.351201 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.351182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 19:59:37.351305 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.351190 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-72fsh\"" Jun 10 19:59:37.351660 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.351642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.352046 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.352001 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 19:59:37.352355 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.352321 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ppp7d\"" Jun 10 19:59:37.352355 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.352356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 19:59:37.352759 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.352565 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 19:59:37.352905 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.352889 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 19:59:37.353184 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.353167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.354320 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354299 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 19:59:37.354545 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.354620 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-system-cni-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.354620 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-cnibin\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.354620 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354608 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 19:59:37.354764 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-k8s-cni-cncf-io\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.354764 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-cni-bin\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.354860 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-etc-kubernetes\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.354860 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-kubernetes\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.354952 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysctl-d\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.355000 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.354977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-systemd\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.355048 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-tmp\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.355147 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355114 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-829fs\"" Jun 10 19:59:37.355147 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-multus-certs\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.355242 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcbvv\" (UniqueName: \"kubernetes.io/projected/657538f0-1491-4054-9928-bbdaa04c4f38-kube-api-access-wcbvv\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.355242 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:37.355242 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-kubelet-config\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.355374 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.355374 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-tuned\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.355459 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqw8x\" (UniqueName: \"kubernetes.io/projected/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-kube-api-access-rqw8x\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.355505 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-socket-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.355616 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-cni-multus\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.355616 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-kubelet\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.355710 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/657538f0-1491-4054-9928-bbdaa04c4f38-multus-daemon-config\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.355710 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-system-cni-dir\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.355921 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355902 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 19:59:37.355994 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-cnibin\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.356044 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355990 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 19:59:37.356096 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356079 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wfkxx\"" Jun 10 19:59:37.356143 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.355989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-sys\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.356143 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-lib-modules\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.356241 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-var-lib-kubelet\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.356241 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-registration-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.356328 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.356328 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-cni-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.356418 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356327 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 19:59:37.356480 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-os-release\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.356578 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.356632 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-modprobe-d\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.357049 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.356989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-run\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.357143 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357057 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 19:59:37.357143 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-device-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.357143 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-sys-fs\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.357313 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-os-release\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.357313 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-netns\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.357313 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysconfig\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.357313 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-socket-dir-parent\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.357551 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdwcm\" (UniqueName: \"kubernetes.io/projected/4fecdbed-8e45-464d-88fd-5fd129de2e4a-kube-api-access-cdwcm\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:37.357551 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.357551 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxvrd\" (UniqueName: \"kubernetes.io/projected/3d0820f1-367c-446e-b50a-02dfec4f6532-kube-api-access-fxvrd\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.357877 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysctl-conf\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.357956 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-hostroot\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.357956 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.357951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-conf-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.358353 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.358331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:37.358564 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.358422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-dbus\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.358564 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.358476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-cni-binary-copy\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.358564 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.358494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-host\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.358564 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.358537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.358846 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.358573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h4r7\" (UniqueName: \"kubernetes.io/projected/fbe45910-01e1-40e8-8054-60be6118a414-kube-api-access-9h4r7\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.358846 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.358639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/657538f0-1491-4054-9928-bbdaa04c4f38-cni-binary-copy\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.383266 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.383241 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kpz7m" Jun 10 19:59:37.393058 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.393037 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kpz7m" Jun 10 19:59:37.446275 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.446248 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 19:59:37.458785 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-dbus\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.458935 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-ovn\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.458935 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.458935 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysconfig\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.458935 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458860 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-dbus\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.458935 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdwcm\" (UniqueName: \"kubernetes.io/projected/4fecdbed-8e45-464d-88fd-5fd129de2e4a-kube-api-access-cdwcm\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:37.458935 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-log-socket\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysconfig\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.458988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a1d15b4-2914-41ce-b24d-429f4a947154-iptables-alerter-script\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94f990e9-05a4-48c2-aad9-d0075b23cab3-hosts-file\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysctl-conf\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-hostroot\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe70f0ef-e304-49e3-8be4-b449289a587c-host\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-hostroot\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x979r\" (UniqueName: \"kubernetes.io/projected/fe70f0ef-e304-49e3-8be4-b449289a587c-kube-api-access-x979r\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzh7k\" (UniqueName: \"kubernetes.io/projected/94f990e9-05a4-48c2-aad9-d0075b23cab3-kube-api-access-tzh7k\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysctl-conf\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.459232 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-cni-binary-copy\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/657538f0-1491-4054-9928-bbdaa04c4f38-cni-binary-copy\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-k8s-cni-cncf-io\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-cni-bin\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcbvv\" (UniqueName: \"kubernetes.io/projected/657538f0-1491-4054-9928-bbdaa04c4f38-kube-api-access-wcbvv\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-k8s-cni-cncf-io\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-var-lib-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459565 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-multus-certs\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-cni-bin\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-kubelet-config\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-multus-certs\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-cni-bin\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-kubelet-config\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds7hc\" (UniqueName: \"kubernetes.io/projected/9c9ccf60-3fc2-466a-990e-96a84e4f2524-kube-api-access-ds7hc\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.459780 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqw8x\" (UniqueName: \"kubernetes.io/projected/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-kube-api-access-rqw8x\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-socket-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-cni-multus\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-kubelet\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-cni-netd\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-cni-binary-copy\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91643a82-0780-4de6-805f-f86134f657a3-konnectivity-ca\") pod \"konnectivity-agent-bxscf\" (UID: \"91643a82-0780-4de6-805f-f86134f657a3\") " pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/657538f0-1491-4054-9928-bbdaa04c4f38-cni-binary-copy\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-cni-multus\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.459978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472d7\" (UniqueName: \"kubernetes.io/projected/6a1d15b4-2914-41ce-b24d-429f4a947154-kube-api-access-472d7\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-sys\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460070 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-var-lib-kubelet\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-os-release\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460126 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-sys\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovnkube-script-lib\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.460544 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460192 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-os-release\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91643a82-0780-4de6-805f-f86134f657a3-agent-certs\") pod \"konnectivity-agent-bxscf\" (UID: \"91643a82-0780-4de6-805f-f86134f657a3\") " pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-modprobe-d\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-socket-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-run\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-netns\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-run\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-modprobe-d\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-socket-dir-parent\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-host-run-netns\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-systemd-units\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-socket-dir-parent\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe70f0ef-e304-49e3-8be4-b449289a587c-serviceca\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a1d15b4-2914-41ce-b24d-429f4a947154-host-slash\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f990e9-05a4-48c2-aad9-d0075b23cab3-tmp-dir\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxvrd\" (UniqueName: \"kubernetes.io/projected/3d0820f1-367c-446e-b50a-02dfec4f6532-kube-api-access-fxvrd\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:37.461317 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-run-netns\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-etc-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-node-log\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-host\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.460691 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-host\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h4r7\" (UniqueName: \"kubernetes.io/projected/fbe45910-01e1-40e8-8054-60be6118a414-kube-api-access-9h4r7\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.460778 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 19:59:37.960739511 +0000 UTC m=+2.981369729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-systemd\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovnkube-config\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-system-cni-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-cnibin\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-system-cni-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.460984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-etc-kubernetes\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461007 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-cnibin\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.462016 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-etc-kubernetes\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-run-ovn-kubernetes\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-kubernetes\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysctl-d\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-systemd\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-tmp\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-kubernetes\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-kubelet\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-systemd\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-env-overrides\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-tuned\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/657538f0-1491-4054-9928-bbdaa04c4f38-multus-daemon-config\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-sysctl-d\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-slash\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovn-node-metrics-cert\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.462723 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-system-cni-dir\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-cnibin\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-lib-modules\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-var-lib-kubelet\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-registration-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-cnibin\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-system-cni-dir\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461452 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-cni-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-conf-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-os-release\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-var-lib-kubelet\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-cni-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-registration-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463263 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/657538f0-1491-4054-9928-bbdaa04c4f38-multus-conf-dir\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461659 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-lib-modules\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-device-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-sys-fs\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/657538f0-1491-4054-9928-bbdaa04c4f38-multus-daemon-config\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461751 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d0820f1-367c-446e-b50a-02dfec4f6532-os-release\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-device-dir\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.461775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fbe45910-01e1-40e8-8054-60be6118a414-sys-fs\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.461802 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.461857 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret podName:85650ef3-ec00-46ba-9833-2f7e8c26b5c3 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:37.961841773 +0000 UTC m=+2.982471982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret") pod "global-pull-secret-syncer-l728l" (UID: "85650ef3-ec00-46ba-9833-2f7e8c26b5c3") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:37.463900 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.462026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d0820f1-367c-446e-b50a-02dfec4f6532-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.464717 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.464697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-etc-tuned\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.464831 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.464732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-tmp\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.468011 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.467983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqw8x\" (UniqueName: \"kubernetes.io/projected/1d5b9847-65bc-4cf2-9faa-15b887a5e4a9-kube-api-access-rqw8x\") pod \"tuned-2lbwl\" (UID: \"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.468593 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.468562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdwcm\" (UniqueName: \"kubernetes.io/projected/4fecdbed-8e45-464d-88fd-5fd129de2e4a-kube-api-access-cdwcm\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:37.468593 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.468566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcbvv\" (UniqueName: \"kubernetes.io/projected/657538f0-1491-4054-9928-bbdaa04c4f38-kube-api-access-wcbvv\") pod \"multus-v6tcl\" (UID: \"657538f0-1491-4054-9928-bbdaa04c4f38\") " pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.469539 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.469481 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:59:37.469539 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.469502 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:59:37.469670 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.469550 2578 projected.go:196] Error preparing data for projected volume kube-api-access-kstn7 for pod openshift-network-diagnostics/network-check-target-j5t2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:37.469670 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.469607 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7 podName:622d9d78-ade0-4b43-b0de-ad409c0ea282 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:37.969590728 +0000 UTC m=+2.990220952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kstn7" (UniqueName: "kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7") pod "network-check-target-j5t2c" (UID: "622d9d78-ade0-4b43-b0de-ad409c0ea282") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:37.470666 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.470648 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h4r7\" (UniqueName: \"kubernetes.io/projected/fbe45910-01e1-40e8-8054-60be6118a414-kube-api-access-9h4r7\") pod \"aws-ebs-csi-driver-node-d9hzp\" (UID: \"fbe45910-01e1-40e8-8054-60be6118a414\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.470749 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.470702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxvrd\" (UniqueName: \"kubernetes.io/projected/3d0820f1-367c-446e-b50a-02dfec4f6532-kube-api-access-fxvrd\") pod \"multus-additional-cni-plugins-dx9lx\" (UID: \"3d0820f1-367c-446e-b50a-02dfec4f6532\") " pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.562495 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe70f0ef-e304-49e3-8be4-b449289a587c-host\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.562674 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x979r\" (UniqueName: \"kubernetes.io/projected/fe70f0ef-e304-49e3-8be4-b449289a587c-kube-api-access-x979r\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.562674 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzh7k\" (UniqueName: \"kubernetes.io/projected/94f990e9-05a4-48c2-aad9-d0075b23cab3-kube-api-access-tzh7k\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.562674 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe70f0ef-e304-49e3-8be4-b449289a587c-host\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.562674 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-var-lib-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562674 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-cni-bin\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562674 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds7hc\" (UniqueName: \"kubernetes.io/projected/9c9ccf60-3fc2-466a-990e-96a84e4f2524-kube-api-access-ds7hc\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562670 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-var-lib-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-cni-netd\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91643a82-0780-4de6-805f-f86134f657a3-konnectivity-ca\") pod \"konnectivity-agent-bxscf\" (UID: \"91643a82-0780-4de6-805f-f86134f657a3\") " pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-cni-netd\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472d7\" (UniqueName: \"kubernetes.io/projected/6a1d15b4-2914-41ce-b24d-429f4a947154-kube-api-access-472d7\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-cni-bin\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovnkube-script-lib\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91643a82-0780-4de6-805f-f86134f657a3-agent-certs\") pod \"konnectivity-agent-bxscf\" (UID: \"91643a82-0780-4de6-805f-f86134f657a3\") " pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-systemd-units\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe70f0ef-e304-49e3-8be4-b449289a587c-serviceca\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a1d15b4-2914-41ce-b24d-429f4a947154-host-slash\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f990e9-05a4-48c2-aad9-d0075b23cab3-tmp-dir\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.562949 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-systemd-units\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a1d15b4-2914-41ce-b24d-429f4a947154-host-slash\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.562942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-run-netns\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-etc-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-node-log\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91643a82-0780-4de6-805f-f86134f657a3-konnectivity-ca\") pod \"konnectivity-agent-bxscf\" (UID: \"91643a82-0780-4de6-805f-f86134f657a3\") " pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-systemd\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovnkube-config\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-systemd\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-etc-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-run-ovn-kubernetes\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-node-log\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94f990e9-05a4-48c2-aad9-d0075b23cab3-tmp-dir\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563431 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe70f0ef-e304-49e3-8be4-b449289a587c-serviceca\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-kubelet\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-run-ovn-kubernetes\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-kubelet\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.563563 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-run-netns\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-env-overrides\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563550 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-openvswitch\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-slash\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563582 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovnkube-script-lib\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovn-node-metrics-cert\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-ovn\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-slash\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-log-socket\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563709 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-run-ovn\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c9ccf60-3fc2-466a-990e-96a84e4f2524-log-socket\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a1d15b4-2914-41ce-b24d-429f4a947154-iptables-alerter-script\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94f990e9-05a4-48c2-aad9-d0075b23cab3-hosts-file\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563836 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovnkube-config\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94f990e9-05a4-48c2-aad9-d0075b23cab3-hosts-file\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.564406 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.563922 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c9ccf60-3fc2-466a-990e-96a84e4f2524-env-overrides\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.565255 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.564206 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a1d15b4-2914-41ce-b24d-429f4a947154-iptables-alerter-script\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.566047 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.566018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91643a82-0780-4de6-805f-f86134f657a3-agent-certs\") pod \"konnectivity-agent-bxscf\" (UID: \"91643a82-0780-4de6-805f-f86134f657a3\") " pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.566161 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.566144 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c9ccf60-3fc2-466a-990e-96a84e4f2524-ovn-node-metrics-cert\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.570917 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.570886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-472d7\" (UniqueName: \"kubernetes.io/projected/6a1d15b4-2914-41ce-b24d-429f4a947154-kube-api-access-472d7\") pod \"iptables-alerter-g2fpf\" (UID: \"6a1d15b4-2914-41ce-b24d-429f4a947154\") " pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.571030 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.570985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds7hc\" (UniqueName: \"kubernetes.io/projected/9c9ccf60-3fc2-466a-990e-96a84e4f2524-kube-api-access-ds7hc\") pod \"ovnkube-node-666mc\" (UID: \"9c9ccf60-3fc2-466a-990e-96a84e4f2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.571429 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.571407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x979r\" (UniqueName: \"kubernetes.io/projected/fe70f0ef-e304-49e3-8be4-b449289a587c-kube-api-access-x979r\") pod \"node-ca-cvmnq\" (UID: \"fe70f0ef-e304-49e3-8be4-b449289a587c\") " pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.572008 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.571986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzh7k\" (UniqueName: \"kubernetes.io/projected/94f990e9-05a4-48c2-aad9-d0075b23cab3-kube-api-access-tzh7k\") pod \"node-resolver-w7q6n\" (UID: \"94f990e9-05a4-48c2-aad9-d0075b23cab3\") " pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.584955 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.584904 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 19:59:37.649917 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.649880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" Jun 10 19:59:37.659059 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.659037 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" Jun 10 19:59:37.667721 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.667702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:37.673304 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.673286 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" Jun 10 19:59:37.679838 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.679821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6tcl" Jun 10 19:59:37.688524 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.688495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g2fpf" Jun 10 19:59:37.695143 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.695126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 19:59:37.701936 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.701918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w7q6n" Jun 10 19:59:37.704481 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.704463 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cvmnq" Jun 10 19:59:37.966619 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.966527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:37.966619 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:37.966595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:37.966837 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.966641 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:37.966837 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.966694 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:37.966837 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.966706 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret podName:85650ef3-ec00-46ba-9833-2f7e8c26b5c3 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:38.96668705 +0000 UTC m=+3.987317282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret") pod "global-pull-secret-syncer-l728l" (UID: "85650ef3-ec00-46ba-9833-2f7e8c26b5c3") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:37.966837 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:37.966744 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 19:59:38.966727901 +0000 UTC m=+3.987358114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:38.067339 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.067301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:38.067492 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.067475 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:59:38.067560 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.067496 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:59:38.067560 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.067505 2578 projected.go:196] Error preparing data for projected volume kube-api-access-kstn7 for pod openshift-network-diagnostics/network-check-target-j5t2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:38.067659 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.067580 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7 podName:622d9d78-ade0-4b43-b0de-ad409c0ea282 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:39.06756278 +0000 UTC m=+4.088193195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kstn7" (UniqueName: "kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7") pod "network-check-target-j5t2c" (UID: "622d9d78-ade0-4b43-b0de-ad409c0ea282") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:38.076801 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.076748 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91643a82_0780_4de6_805f_f86134f657a3.slice/crio-78de6be2bb1cd38ad404de4ef3dad107e21616ae6a3e9ee72e601f6a0b787204 WatchSource:0}: Error finding container 78de6be2bb1cd38ad404de4ef3dad107e21616ae6a3e9ee72e601f6a0b787204: Status 404 returned error can't find the container with id 78de6be2bb1cd38ad404de4ef3dad107e21616ae6a3e9ee72e601f6a0b787204 Jun 10 19:59:38.077600 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.077528 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1d15b4_2914_41ce_b24d_429f4a947154.slice/crio-a33e7dfdd2d399355f8e2ee9ac3182337cc331a310ddba3fc728726d32885785 WatchSource:0}: Error finding container a33e7dfdd2d399355f8e2ee9ac3182337cc331a310ddba3fc728726d32885785: Status 404 returned error can't find the container with id a33e7dfdd2d399355f8e2ee9ac3182337cc331a310ddba3fc728726d32885785 Jun 10 19:59:38.078834 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.078815 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9ccf60_3fc2_466a_990e_96a84e4f2524.slice/crio-0c8f76deb17045f414eee0ab364fb39d45656ca44ea666c78d412606e2b27f94 WatchSource:0}: Error finding container 0c8f76deb17045f414eee0ab364fb39d45656ca44ea666c78d412606e2b27f94: Status 404 returned error can't find the container with id 0c8f76deb17045f414eee0ab364fb39d45656ca44ea666c78d412606e2b27f94 Jun 10 19:59:38.082804 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.082784 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f990e9_05a4_48c2_aad9_d0075b23cab3.slice/crio-a4b346823de4b6358ebfbb7f9260afefceee7404fe92017bd6d941d73f99dad2 WatchSource:0}: Error finding container a4b346823de4b6358ebfbb7f9260afefceee7404fe92017bd6d941d73f99dad2: Status 404 returned error can't find the container with id a4b346823de4b6358ebfbb7f9260afefceee7404fe92017bd6d941d73f99dad2 Jun 10 19:59:38.083876 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.083858 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657538f0_1491_4054_9928_bbdaa04c4f38.slice/crio-9cc00ca2dda80907957492a2f0382e05ec74dffde4d65cdf20019b31333687ed WatchSource:0}: Error finding container 9cc00ca2dda80907957492a2f0382e05ec74dffde4d65cdf20019b31333687ed: Status 404 returned error can't find the container with id 9cc00ca2dda80907957492a2f0382e05ec74dffde4d65cdf20019b31333687ed Jun 10 19:59:38.085253 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.085237 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5b9847_65bc_4cf2_9faa_15b887a5e4a9.slice/crio-df8306c62c2c23b6c15e1cfdb28e667acd4e892d0c6c0eb93ab279af116ed64e WatchSource:0}: Error finding container df8306c62c2c23b6c15e1cfdb28e667acd4e892d0c6c0eb93ab279af116ed64e: Status 404 returned error can't find the container with id df8306c62c2c23b6c15e1cfdb28e667acd4e892d0c6c0eb93ab279af116ed64e Jun 10 19:59:38.086201 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.086179 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0820f1_367c_446e_b50a_02dfec4f6532.slice/crio-ac4e1f657e1d77bb15620769275f23348f3401d8235be300f1ea7d92ae61ba7b WatchSource:0}: Error finding container ac4e1f657e1d77bb15620769275f23348f3401d8235be300f1ea7d92ae61ba7b: Status 404 returned error can't find the container with id ac4e1f657e1d77bb15620769275f23348f3401d8235be300f1ea7d92ae61ba7b Jun 10 19:59:38.087487 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.087350 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe45910_01e1_40e8_8054_60be6118a414.slice/crio-39c2185f87206ec55749a766307884ab1cd9bb483d07952976c7979962542336 WatchSource:0}: Error finding container 39c2185f87206ec55749a766307884ab1cd9bb483d07952976c7979962542336: Status 404 returned error can't find the container with id 39c2185f87206ec55749a766307884ab1cd9bb483d07952976c7979962542336 Jun 10 19:59:38.089119 ip-10-0-138-104 kubenswrapper[2578]: W0610 19:59:38.088938 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe70f0ef_e304_49e3_8be4_b449289a587c.slice/crio-0baba9453ccb94df5f1ae3e8070fb0ec5b64dda29f6d2e138c8ed0025e8fe51d WatchSource:0}: Error finding container 0baba9453ccb94df5f1ae3e8070fb0ec5b64dda29f6d2e138c8ed0025e8fe51d: Status 404 returned error can't find the container with id 0baba9453ccb94df5f1ae3e8070fb0ec5b64dda29f6d2e138c8ed0025e8fe51d Jun 10 19:59:38.395702 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.395524 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 19:54:37 +0000 UTC" deadline="2027-11-07 14:11:57.191158645 +0000 UTC" Jun 10 19:59:38.395702 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.395696 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12354h12m18.795465461s" Jun 10 19:59:38.418936 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.418914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:38.419066 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.419034 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:38.428816 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.428687 2578 generic.go:356] "Generic (PLEG): container finished" podID="02bf2e9816258b659dc9bb410fab8ee2" containerID="a3fa4443c6088a2d377cd3e935f4c88166a246567b9817c806535fba6cac1a8f" exitCode=0 Jun 10 19:59:38.429074 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.429041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" event={"ID":"02bf2e9816258b659dc9bb410fab8ee2","Type":"ContainerDied","Data":"a3fa4443c6088a2d377cd3e935f4c88166a246567b9817c806535fba6cac1a8f"} Jun 10 19:59:38.430667 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.430637 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" event={"ID":"775f0be1eafb59e9bc4d24df466e4a75","Type":"ContainerStarted","Data":"1eb31984f75b196c2622dbd4cc864414ea08b30e86ac45d7d2810c5c98aff533"} Jun 10 19:59:38.432941 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.432874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cvmnq" event={"ID":"fe70f0ef-e304-49e3-8be4-b449289a587c","Type":"ContainerStarted","Data":"0baba9453ccb94df5f1ae3e8070fb0ec5b64dda29f6d2e138c8ed0025e8fe51d"} Jun 10 19:59:38.437487 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.437205 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerStarted","Data":"ac4e1f657e1d77bb15620769275f23348f3401d8235be300f1ea7d92ae61ba7b"} Jun 10 19:59:38.440484 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.440442 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" event={"ID":"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9","Type":"ContainerStarted","Data":"df8306c62c2c23b6c15e1cfdb28e667acd4e892d0c6c0eb93ab279af116ed64e"} Jun 10 19:59:38.443110 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.442883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6tcl" event={"ID":"657538f0-1491-4054-9928-bbdaa04c4f38","Type":"ContainerStarted","Data":"9cc00ca2dda80907957492a2f0382e05ec74dffde4d65cdf20019b31333687ed"} Jun 10 19:59:38.444253 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.444178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w7q6n" event={"ID":"94f990e9-05a4-48c2-aad9-d0075b23cab3","Type":"ContainerStarted","Data":"a4b346823de4b6358ebfbb7f9260afefceee7404fe92017bd6d941d73f99dad2"} Jun 10 19:59:38.445686 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.445660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"0c8f76deb17045f414eee0ab364fb39d45656ca44ea666c78d412606e2b27f94"} Jun 10 19:59:38.447278 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.447204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" event={"ID":"fbe45910-01e1-40e8-8054-60be6118a414","Type":"ContainerStarted","Data":"39c2185f87206ec55749a766307884ab1cd9bb483d07952976c7979962542336"} Jun 10 19:59:38.448649 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.448593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2fpf" event={"ID":"6a1d15b4-2914-41ce-b24d-429f4a947154","Type":"ContainerStarted","Data":"a33e7dfdd2d399355f8e2ee9ac3182337cc331a310ddba3fc728726d32885785"} Jun 10 19:59:38.453280 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.453246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bxscf" event={"ID":"91643a82-0780-4de6-805f-f86134f657a3","Type":"ContainerStarted","Data":"78de6be2bb1cd38ad404de4ef3dad107e21616ae6a3e9ee72e601f6a0b787204"} Jun 10 19:59:38.974272 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.974189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:38.974272 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:38.974266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:38.974490 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.974409 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:38.974490 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.974472 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret podName:85650ef3-ec00-46ba-9833-2f7e8c26b5c3 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:40.974453701 +0000 UTC m=+5.995083929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret") pod "global-pull-secret-syncer-l728l" (UID: "85650ef3-ec00-46ba-9833-2f7e8c26b5c3") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:38.974767 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.974556 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:38.974767 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:38.974615 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 19:59:40.974597845 +0000 UTC m=+5.995228059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:39.075299 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:39.075263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:39.075492 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:39.075475 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:59:39.075587 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:39.075502 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:59:39.075587 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:39.075551 2578 projected.go:196] Error preparing data for projected volume kube-api-access-kstn7 for pod openshift-network-diagnostics/network-check-target-j5t2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:39.075690 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:39.075617 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7 podName:622d9d78-ade0-4b43-b0de-ad409c0ea282 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:41.075598622 +0000 UTC m=+6.096228833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kstn7" (UniqueName: "kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7") pod "network-check-target-j5t2c" (UID: "622d9d78-ade0-4b43-b0de-ad409c0ea282") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:39.396279 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:39.396185 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 19:54:37 +0000 UTC" deadline="2028-01-12 00:15:36.335708158 +0000 UTC" Jun 10 19:59:39.396279 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:39.396227 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13924h15m56.93948574s" Jun 10 19:59:39.421011 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:39.420984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:39.421163 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:39.421126 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:39.421564 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:39.421544 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:39.421663 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:39.421643 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:39.482617 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:39.482578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" event={"ID":"02bf2e9816258b659dc9bb410fab8ee2","Type":"ContainerStarted","Data":"b05b525c740bc355ff01760e83595e8427acfcf34119c42894ba523dc174947b"} Jun 10 19:59:39.497345 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:39.497272 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" podStartSLOduration=3.497248173 podStartE2EDuration="3.497248173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:38.465784329 +0000 UTC m=+3.486414563" watchObservedRunningTime="2026-06-10 19:59:39.497248173 +0000 UTC m=+4.517878405" Jun 10 19:59:40.418767 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:40.418733 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:40.419247 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:40.418845 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:40.993367 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:40.993323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:40.993569 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:40.993412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:40.993637 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:40.993574 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:40.993709 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:40.993637 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret podName:85650ef3-ec00-46ba-9833-2f7e8c26b5c3 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:44.993619 +0000 UTC m=+10.014249246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret") pod "global-pull-secret-syncer-l728l" (UID: "85650ef3-ec00-46ba-9833-2f7e8c26b5c3") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:40.994036 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:40.994016 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:40.994116 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:40.994075 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 19:59:44.994059763 +0000 UTC m=+10.014689978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:41.094974 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:41.094922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:41.095135 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:41.095122 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:59:41.095211 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:41.095142 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:59:41.095211 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:41.095155 2578 projected.go:196] Error preparing data for projected volume kube-api-access-kstn7 for pod openshift-network-diagnostics/network-check-target-j5t2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:41.095308 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:41.095211 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7 podName:622d9d78-ade0-4b43-b0de-ad409c0ea282 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:45.095194031 +0000 UTC m=+10.115824242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kstn7" (UniqueName: "kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7") pod "network-check-target-j5t2c" (UID: "622d9d78-ade0-4b43-b0de-ad409c0ea282") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:41.418980 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:41.418950 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:41.419503 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:41.418982 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:41.419503 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:41.419090 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:41.419503 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:41.419252 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:42.419240 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:42.419189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:42.419706 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:42.419314 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:43.418959 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:43.418928 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:43.419121 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:43.418932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:43.419121 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:43.419083 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:43.419239 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:43.419159 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:44.418758 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:44.418726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:44.419175 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:44.418861 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:45.027593 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:45.027532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:45.027792 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:45.027612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:45.027792 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.027740 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:45.027921 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.027800 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret podName:85650ef3-ec00-46ba-9833-2f7e8c26b5c3 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:53.02778063 +0000 UTC m=+18.048410854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret") pod "global-pull-secret-syncer-l728l" (UID: "85650ef3-ec00-46ba-9833-2f7e8c26b5c3") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:45.027921 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.027866 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:45.027921 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.027901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 19:59:53.027888552 +0000 UTC m=+18.048518774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:45.128211 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:45.128093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:45.128391 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.128309 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:59:45.128391 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.128327 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:59:45.128391 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.128339 2578 projected.go:196] Error preparing data for projected volume kube-api-access-kstn7 for pod openshift-network-diagnostics/network-check-target-j5t2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:45.128570 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.128396 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7 podName:622d9d78-ade0-4b43-b0de-ad409c0ea282 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:53.128378778 +0000 UTC m=+18.149008989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kstn7" (UniqueName: "kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7") pod "network-check-target-j5t2c" (UID: "622d9d78-ade0-4b43-b0de-ad409c0ea282") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:45.424165 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:45.424135 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:45.424690 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.424283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:45.424765 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:45.424707 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:45.425220 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:45.424839 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:46.418619 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:46.418580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:46.418788 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:46.418721 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:47.419429 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:47.419360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:47.419429 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:47.419399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:47.419901 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:47.419529 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:47.419901 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:47.419611 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:48.418929 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:48.418906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:48.419020 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:48.419003 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:49.419165 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:49.419131 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:49.419629 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:49.419328 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:49.419629 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:49.419388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:49.419629 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:49.419501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:50.419195 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:50.419165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:50.419681 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:50.419282 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:51.419484 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:51.419457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:51.419925 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:51.419457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:51.419925 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:51.419592 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:51.419925 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:51.419649 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:52.418592 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:52.418452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:52.418790 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:52.418596 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:53.086557 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:53.086518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:53.087060 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:53.086594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:53.087060 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.086674 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:53.087060 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.086696 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:53.087060 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.086743 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 20:00:09.086724825 +0000 UTC m=+34.107355050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 19:59:53.087060 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.086759 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret podName:85650ef3-ec00-46ba-9833-2f7e8c26b5c3 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:09.086752398 +0000 UTC m=+34.107382607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret") pod "global-pull-secret-syncer-l728l" (UID: "85650ef3-ec00-46ba-9833-2f7e8c26b5c3") : object "kube-system"/"original-pull-secret" not registered Jun 10 19:59:53.187245 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:53.187210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:53.187403 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.187384 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 19:59:53.187450 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.187404 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 19:59:53.187450 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.187413 2578 projected.go:196] Error preparing data for projected volume kube-api-access-kstn7 for pod openshift-network-diagnostics/network-check-target-j5t2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:53.187544 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.187471 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7 podName:622d9d78-ade0-4b43-b0de-ad409c0ea282 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:09.187450527 +0000 UTC m=+34.208080736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kstn7" (UniqueName: "kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7") pod "network-check-target-j5t2c" (UID: "622d9d78-ade0-4b43-b0de-ad409c0ea282") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 19:59:53.419131 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:53.419055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:53.419287 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:53.419063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:53.419287 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.419191 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:53.419287 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:53.419255 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:54.418626 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:54.418590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:54.419005 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:54.418703 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:55.419533 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:55.419484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:55.420021 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:55.419625 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:55.420021 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:55.419680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:55.420021 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:55.419771 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:56.419186 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:56.419147 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:56.419420 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:56.419258 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:57.419017 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.418872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:57.419486 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.418872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:57.419486 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:57.419097 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:57.419486 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:57.419166 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:57.521690 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.521395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cvmnq" event={"ID":"fe70f0ef-e304-49e3-8be4-b449289a587c","Type":"ContainerStarted","Data":"7dddd0b072645162c94519aef033717abf997b7d722fd1acd8ddcfc06fae6ff3"} Jun 10 19:59:57.523146 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.523121 2578 generic.go:356] "Generic (PLEG): container finished" podID="3d0820f1-367c-446e-b50a-02dfec4f6532" containerID="3629c2800b49a75c663962373e9ab0b23956afac4425a22a267735e37e9db4ce" exitCode=0 Jun 10 19:59:57.523257 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.523183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerDied","Data":"3629c2800b49a75c663962373e9ab0b23956afac4425a22a267735e37e9db4ce"} Jun 10 19:59:57.524721 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.524679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" event={"ID":"1d5b9847-65bc-4cf2-9faa-15b887a5e4a9","Type":"ContainerStarted","Data":"f9364d117a72a7ced06a162fb0a868b17629ddf8af42fe9beaabb3da6b1cf23a"} Jun 10 19:59:57.526006 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.525978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6tcl" event={"ID":"657538f0-1491-4054-9928-bbdaa04c4f38","Type":"ContainerStarted","Data":"eb50c5073f27e7a01f42ad580afc3fd7a20e1501157ed81f5ca95c25101933fd"} Jun 10 19:59:57.527336 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.527319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w7q6n" event={"ID":"94f990e9-05a4-48c2-aad9-d0075b23cab3","Type":"ContainerStarted","Data":"69f8dc8bac41b3e4d6685ceaf3fd203c4ec1be6206fe7135ac54a2b969076324"} Jun 10 19:59:57.530401 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.530378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"4a06ddf40bc3265c8f00c84caa84a370c6e2861eaa598977a3a6ec1e695c5734"} Jun 10 19:59:57.530480 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.530435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"7964df6bd871fcfcca92896b4daf340e28cea6b0f9c6cb5b17e46c590f210be6"} Jun 10 19:59:57.530551 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.530479 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"c874c37e1310b4f7940c4da4e0747ae57eb7fa8e65e42bd73c494ea3753839f4"} Jun 10 19:59:57.530551 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.530532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"7c16c94b4ce0c9a1ee9b3d735476e1a07b58ecb4f75c4c42eaa6bcf9ef93b44a"} Jun 10 19:59:57.530641 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.530568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"85bd60dd8e19c0ca1c958978c89e5ec9d538e723c6938310f28f203ddefef675"} Jun 10 19:59:57.530641 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.530611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"42b4e44ff91692b9011f5915693cfded368746b34b7287eb55bfb09327f46bb4"} Jun 10 19:59:57.531617 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.531599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" event={"ID":"fbe45910-01e1-40e8-8054-60be6118a414","Type":"ContainerStarted","Data":"93b3e1c5511aa7658e2eb32b25cde6e12b2de7dd5336bf6642892b618f26caf0"} Jun 10 19:59:57.532824 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.532808 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bxscf" event={"ID":"91643a82-0780-4de6-805f-f86134f657a3","Type":"ContainerStarted","Data":"b8b9b2980084cb9d4b4d2d39af01cb7fac94dde160adac2fa8e8c68b0b69ddf5"} Jun 10 19:59:57.535470 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.535435 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" podStartSLOduration=21.535424541 podStartE2EDuration="21.535424541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:39.497793402 +0000 UTC m=+4.518423633" watchObservedRunningTime="2026-06-10 19:59:57.535424541 +0000 UTC m=+22.556054772" Jun 10 19:59:57.535856 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.535833 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cvmnq" podStartSLOduration=3.875365302 podStartE2EDuration="22.535824044s" totalImagesPullingTime="18.660458742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:57.535420466 +0000 UTC m=+22.556050697" watchObservedRunningTime="2026-06-10 19:59:57.535824044 +0000 UTC m=+22.556454274" Jun 10 19:59:57.574617 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.574555 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2lbwl" podStartSLOduration=3.911183193 podStartE2EDuration="22.574536722s" totalImagesPullingTime="18.663353529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:57.574087569 +0000 UTC m=+22.594717801" watchObservedRunningTime="2026-06-10 19:59:57.574536722 +0000 UTC m=+22.595166950" Jun 10 19:59:57.601715 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.601654 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v6tcl" podStartSLOduration=3.911455604 podStartE2EDuration="22.601627575s" totalImagesPullingTime="18.690171971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:57.600335691 +0000 UTC m=+22.620965919" watchObservedRunningTime="2026-06-10 19:59:57.601627575 +0000 UTC m=+22.622257806" Jun 10 19:59:57.669005 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.668958 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bxscf" podStartSLOduration=8.645300374 podStartE2EDuration="22.668940818s" totalImagesPullingTime="14.023640444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:57.644466323 +0000 UTC m=+22.665096555" watchObservedRunningTime="2026-06-10 19:59:57.668940818 +0000 UTC m=+22.689571050" Jun 10 19:59:57.669644 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:57.669581 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w7q6n" podStartSLOduration=4.028337391 podStartE2EDuration="22.66956864s" totalImagesPullingTime="18.641231249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:57.668694742 +0000 UTC m=+22.689324973" watchObservedRunningTime="2026-06-10 19:59:57.66956864 +0000 UTC m=+22.690198883" Jun 10 19:59:58.414481 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:58.414453 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 19:59:58.418471 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:58.418456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 19:59:58.418596 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:58.418563 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 19:59:58.537711 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:58.537676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" event={"ID":"fbe45910-01e1-40e8-8054-60be6118a414","Type":"ContainerStarted","Data":"a1eea57787eaf27bb845696254adf8d86fcba560f6342daedf075d65a4f3856f"} Jun 10 19:59:58.539446 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:58.539372 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g2fpf" event={"ID":"6a1d15b4-2914-41ce-b24d-429f4a947154","Type":"ContainerStarted","Data":"c3a14204b5890bc92cdaeab02cdf61437b0a07455de9fa64b69fd681a2f48553"} Jun 10 19:59:58.554586 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:58.554523 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g2fpf" podStartSLOduration=5.184004721 podStartE2EDuration="23.554489645s" totalImagesPullingTime="18.370484924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:58.553988964 +0000 UTC m=+23.574619196" watchObservedRunningTime="2026-06-10 19:59:58.554489645 +0000 UTC m=+23.575119886" Jun 10 19:59:59.414844 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.414736 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T19:59:58.414476078Z","UUID":"ad626cb8-fba4-4e83-befd-3db59c3ba9bd","Handler":null,"Name":"","Endpoint":""} Jun 10 19:59:59.416523 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.416488 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 19:59:59.416648 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.416541 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 19:59:59.418996 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.418971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 19:59:59.419126 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:59.419104 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 19:59:59.419402 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.419380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 19:59:59.419679 ip-10-0-138-104 kubenswrapper[2578]: E0610 19:59:59.419484 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 19:59:59.498403 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.498371 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:59.499036 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.499013 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:59.542240 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.542211 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bxscf" Jun 10 19:59:59.542727 ip-10-0-138-104 kubenswrapper[2578]: I0610 19:59:59.542647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bxscf" Jun 10 20:00:00.418645 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:00.418613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:00.418808 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:00.418726 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 20:00:00.548188 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:00.548153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"6b82a566f1e64d0793a5f62b7bf9164e495dfdbefcac1d4f14972c4195d86e38"} Jun 10 20:00:00.550442 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:00.550416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" event={"ID":"fbe45910-01e1-40e8-8054-60be6118a414","Type":"ContainerStarted","Data":"c61d447e57277f6c6deafd655d931c85ab8ecfcaf0619d21ac3e99ca3e74ee82"} Jun 10 20:00:00.568374 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:00.568336 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9hzp" podStartSLOduration=4.405812423 podStartE2EDuration="25.56832383s" totalImagesPullingTime="21.162511407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:00.568031582 +0000 UTC m=+25.588661812" watchObservedRunningTime="2026-06-10 20:00:00.56832383 +0000 UTC m=+25.588954060" Jun 10 20:00:01.419053 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:01.419019 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:01.419238 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:01.419160 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:00:01.419238 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:01.419173 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:01.419352 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:01.419277 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 20:00:02.419441 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.419273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:02.419943 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:02.419507 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 20:00:02.556590 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.556558 2578 generic.go:356] "Generic (PLEG): container finished" podID="3d0820f1-367c-446e-b50a-02dfec4f6532" containerID="498d1840694e49222a2227eda2cc40e5344591b89584a3c4b50fb9f6d164d990" exitCode=0 Jun 10 20:00:02.556753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.556649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerDied","Data":"498d1840694e49222a2227eda2cc40e5344591b89584a3c4b50fb9f6d164d990"} Jun 10 20:00:02.560203 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.560183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" event={"ID":"9c9ccf60-3fc2-466a-990e-96a84e4f2524","Type":"ContainerStarted","Data":"c8b2d43007c426dbec56cceec4ec1ba60075a941fd407a3a68080702194db7e1"} Jun 10 20:00:02.560448 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.560418 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 20:00:02.560576 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.560472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 20:00:02.575636 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.575615 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 20:00:02.604418 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:02.604373 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" podStartSLOduration=8.868430026 podStartE2EDuration="27.604361116s" totalImagesPullingTime="18.73593109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:02.603962153 +0000 UTC m=+27.624592383" watchObservedRunningTime="2026-06-10 20:00:02.604361116 +0000 UTC m=+27.624991367" Jun 10 20:00:03.418695 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.418661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:03.418890 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.418711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:03.418890 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:03.418812 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:00:03.418966 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:03.418913 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 20:00:03.563450 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.563421 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 20:00:03.579288 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.579261 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 20:00:03.815446 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.815281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkwx6"] Jun 10 20:00:03.815572 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.815550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:03.815671 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:03.815646 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:00:03.821399 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.821365 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5t2c"] Jun 10 20:00:03.821547 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.821500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:03.821659 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:03.821623 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 20:00:03.822063 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.822043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l728l"] Jun 10 20:00:03.822139 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:03.822114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:03.822211 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:03.822188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 20:00:04.566856 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:04.566823 2578 generic.go:356] "Generic (PLEG): container finished" podID="3d0820f1-367c-446e-b50a-02dfec4f6532" containerID="f7cd61c55360124c0cdaf5cad87962262852e70d7a7ca0cfa88fc4e97f9af9b4" exitCode=0 Jun 10 20:00:04.567432 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:04.566900 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerDied","Data":"f7cd61c55360124c0cdaf5cad87962262852e70d7a7ca0cfa88fc4e97f9af9b4"} Jun 10 20:00:05.419885 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:05.419853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:05.420064 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:05.419945 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:00:05.420064 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:05.419957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:05.420064 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:05.420005 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:05.420191 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:05.420081 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 20:00:05.420191 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:05.420153 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 20:00:06.573892 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:06.573858 2578 generic.go:356] "Generic (PLEG): container finished" podID="3d0820f1-367c-446e-b50a-02dfec4f6532" containerID="9127ecab45ed48028674c536de9de1ded29fa90eb4b08cd27d4452065405bab7" exitCode=0 Jun 10 20:00:06.574401 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:06.573926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerDied","Data":"9127ecab45ed48028674c536de9de1ded29fa90eb4b08cd27d4452065405bab7"} Jun 10 20:00:07.419505 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:07.419467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:07.419710 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:07.419467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:07.419710 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:07.419609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:07.419710 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:07.419626 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:00:07.419710 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:07.419682 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 20:00:07.419924 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:07.419784 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 20:00:09.106331 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.106302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:09.106753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.106359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:09.106753 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.106479 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:00:09.106753 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.106481 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:00:09.106753 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.106560 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret podName:85650ef3-ec00-46ba-9833-2f7e8c26b5c3 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:41.106545662 +0000 UTC m=+66.127175870 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret") pod "global-pull-secret-syncer-l728l" (UID: "85650ef3-ec00-46ba-9833-2f7e8c26b5c3") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:00:09.106753 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.106576 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 20:00:41.106568807 +0000 UTC m=+66.127199016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:00:09.206941 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.206902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:09.207107 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.207082 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:00:09.207107 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.207104 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:00:09.207193 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.207118 2578 projected.go:196] Error preparing data for projected volume kube-api-access-kstn7 for pod openshift-network-diagnostics/network-check-target-j5t2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:00:09.207193 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.207175 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7 podName:622d9d78-ade0-4b43-b0de-ad409c0ea282 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:41.207157279 +0000 UTC m=+66.227787489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kstn7" (UniqueName: "kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7") pod "network-check-target-j5t2c" (UID: "622d9d78-ade0-4b43-b0de-ad409c0ea282") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:00:09.423449 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.423184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:09.423610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.423181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:09.423610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.423212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:09.423610 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.423553 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:00:09.423752 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.423614 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5t2c" podUID="622d9d78-ade0-4b43-b0de-ad409c0ea282" Jun 10 20:00:09.423752 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:09.423693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l728l" podUID="85650ef3-ec00-46ba-9833-2f7e8c26b5c3" Jun 10 20:00:09.788749 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.788673 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeReady" Jun 10 20:00:09.788902 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.788824 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 20:00:09.821701 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.821467 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f57d48f9b-kmzls"] Jun 10 20:00:09.824022 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.823998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.826798 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.826776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxn4f\"" Jun 10 20:00:09.826996 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.826974 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 20:00:09.827119 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.826997 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 20:00:09.827119 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.827074 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 20:00:09.835417 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.835384 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 20:00:09.837355 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.837335 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f57d48f9b-kmzls"] Jun 10 20:00:09.839785 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.839764 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zdprg"] Jun 10 20:00:09.841537 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.841500 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-89lsn"] Jun 10 20:00:09.841653 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.841633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:09.843650 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.843614 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:09.843865 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.843845 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jb7fp\"" Jun 10 20:00:09.844127 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.844108 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 20:00:09.844210 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.844161 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 20:00:09.846049 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.845881 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 20:00:09.846049 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.845897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hfchf\"" Jun 10 20:00:09.846049 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.845897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 20:00:09.846049 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.845948 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 20:00:09.852460 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.852439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-89lsn"] Jun 10 20:00:09.854037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.853987 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zdprg"] Jun 10 20:00:09.911475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/823d184c-ddba-4a61-a541-9b409a41fbac-ca-trust-extracted\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.911475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wgqk\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-kube-api-access-7wgqk\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.911730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-installation-pull-secrets\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.911730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.911730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-trusted-ca\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.911730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-registry-certificates\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.911730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-bound-sa-token\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:09.911958 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:09.911826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-image-registry-private-configuration\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.012640 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/823d184c-ddba-4a61-a541-9b409a41fbac-ca-trust-extracted\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.012640 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wgqk\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-kube-api-access-7wgqk\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.012871 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-installation-pull-secrets\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.012871 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zssfv\" (UniqueName: \"kubernetes.io/projected/f882e4ed-c9aa-440d-87a8-067231d28e9f-kube-api-access-zssfv\") pod \"ingress-canary-89lsn\" (UID: \"f882e4ed-c9aa-440d-87a8-067231d28e9f\") " pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:10.012871 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de2132a1-d324-4ec6-b2c3-95851da6e9f2-tmp-dir\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.012871 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.012871 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.012838 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:00:10.012871 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.012853 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-trusted-ca\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.012923 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:00:10.512901991 +0000 UTC m=+35.533532233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de2132a1-d324-4ec6-b2c3-95851da6e9f2-config-volume\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.012972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lvgx\" (UniqueName: \"kubernetes.io/projected/de2132a1-d324-4ec6-b2c3-95851da6e9f2-kube-api-access-9lvgx\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-registry-certificates\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013060 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/823d184c-ddba-4a61-a541-9b409a41fbac-ca-trust-extracted\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-bound-sa-token\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.013113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f882e4ed-c9aa-440d-87a8-067231d28e9f-cert\") pod \"ingress-canary-89lsn\" (UID: \"f882e4ed-c9aa-440d-87a8-067231d28e9f\") " pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:10.013728 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.013728 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-image-registry-private-configuration\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.013728 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-registry-certificates\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.013883 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.013813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-trusted-ca\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.017353 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.017324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-image-registry-private-configuration\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.017353 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.017338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-installation-pull-secrets\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.023312 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.023277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-bound-sa-token\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.023529 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.023495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wgqk\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-kube-api-access-7wgqk\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.114018 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.113983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f882e4ed-c9aa-440d-87a8-067231d28e9f-cert\") pod \"ingress-canary-89lsn\" (UID: \"f882e4ed-c9aa-440d-87a8-067231d28e9f\") " pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:10.114018 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.114024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.114546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.114121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zssfv\" (UniqueName: \"kubernetes.io/projected/f882e4ed-c9aa-440d-87a8-067231d28e9f-kube-api-access-zssfv\") pod \"ingress-canary-89lsn\" (UID: \"f882e4ed-c9aa-440d-87a8-067231d28e9f\") " pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:10.114546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.114148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de2132a1-d324-4ec6-b2c3-95851da6e9f2-tmp-dir\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.114546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.114193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de2132a1-d324-4ec6-b2c3-95851da6e9f2-config-volume\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.114546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.114220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lvgx\" (UniqueName: \"kubernetes.io/projected/de2132a1-d324-4ec6-b2c3-95851da6e9f2-kube-api-access-9lvgx\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.114546 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.114226 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:00:10.114546 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.114308 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:10.6142868 +0000 UTC m=+35.634917026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:00:10.114546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.114472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de2132a1-d324-4ec6-b2c3-95851da6e9f2-tmp-dir\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.114892 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.114864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/de2132a1-d324-4ec6-b2c3-95851da6e9f2-config-volume\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.116552 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.116530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f882e4ed-c9aa-440d-87a8-067231d28e9f-cert\") pod \"ingress-canary-89lsn\" (UID: \"f882e4ed-c9aa-440d-87a8-067231d28e9f\") " pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:10.122772 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.122748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zssfv\" (UniqueName: \"kubernetes.io/projected/f882e4ed-c9aa-440d-87a8-067231d28e9f-kube-api-access-zssfv\") pod \"ingress-canary-89lsn\" (UID: \"f882e4ed-c9aa-440d-87a8-067231d28e9f\") " pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:10.122859 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.122783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lvgx\" (UniqueName: \"kubernetes.io/projected/de2132a1-d324-4ec6-b2c3-95851da6e9f2-kube-api-access-9lvgx\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.160989 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.160958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-89lsn" Jun 10 20:00:10.516487 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.516453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:10.516644 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.516582 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:00:10.516644 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.516594 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:00:10.516644 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.516644 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:00:11.516629402 +0000 UTC m=+36.537259611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:00:10.538547 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.538521 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-89lsn"] Jun 10 20:00:10.543162 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:00:10.543129 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf882e4ed_c9aa_440d_87a8_067231d28e9f.slice/crio-6902d0677c4498e511a53765e6a3677dfafff273c0c765bdb490f6c11901b664 WatchSource:0}: Error finding container 6902d0677c4498e511a53765e6a3677dfafff273c0c765bdb490f6c11901b664: Status 404 returned error can't find the container with id 6902d0677c4498e511a53765e6a3677dfafff273c0c765bdb490f6c11901b664 Jun 10 20:00:10.587367 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.587328 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerStarted","Data":"1e30e05de3de243ca538f3f2af4083ee9a78bfbe136c2b0263b68ddff2a8dfb5"} Jun 10 20:00:10.588480 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.588451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-89lsn" event={"ID":"f882e4ed-c9aa-440d-87a8-067231d28e9f","Type":"ContainerStarted","Data":"6902d0677c4498e511a53765e6a3677dfafff273c0c765bdb490f6c11901b664"} Jun 10 20:00:10.617421 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:10.617392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:10.617606 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.617583 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:00:10.617704 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:10.617654 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:11.617634896 +0000 UTC m=+36.638265106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:00:11.419475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.419442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:11.419948 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.419442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:11.419948 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.419442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:11.422299 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.421827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:00:11.422299 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.421970 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:00:11.422943 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.422922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:00:11.423027 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.422960 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:00:11.423027 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.422965 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5ggwg\"" Jun 10 20:00:11.423148 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.423087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqgjk\"" Jun 10 20:00:11.522891 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.522847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:11.523061 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:11.522961 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:00:11.523061 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:11.522974 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:00:11.523061 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:11.523030 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:00:13.523011692 +0000 UTC m=+38.543641902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:00:11.594403 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.594373 2578 generic.go:356] "Generic (PLEG): container finished" podID="3d0820f1-367c-446e-b50a-02dfec4f6532" containerID="1e30e05de3de243ca538f3f2af4083ee9a78bfbe136c2b0263b68ddff2a8dfb5" exitCode=0 Jun 10 20:00:11.594610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.594439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerDied","Data":"1e30e05de3de243ca538f3f2af4083ee9a78bfbe136c2b0263b68ddff2a8dfb5"} Jun 10 20:00:11.623897 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:11.623840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:11.624105 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:11.624085 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:00:11.624191 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:11.624156 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:13.624138761 +0000 UTC m=+38.644768984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:00:12.277112 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:12.277051 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:12.356826 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:12.356790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:12.601387 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:12.601342 2578 generic.go:356] "Generic (PLEG): container finished" podID="3d0820f1-367c-446e-b50a-02dfec4f6532" containerID="b54da53d668e9b0c52032fa6e4e0e497a9cc41d3dd0184e88c5665a9d04fac6b" exitCode=0 Jun 10 20:00:12.601817 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:12.601406 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerDied","Data":"b54da53d668e9b0c52032fa6e4e0e497a9cc41d3dd0184e88c5665a9d04fac6b"} Jun 10 20:00:13.540749 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.540716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:13.540903 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:13.540863 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:00:13.540903 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:13.540880 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:00:13.540971 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:13.540934 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:00:17.540917575 +0000 UTC m=+42.561547803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:00:13.604700 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.604667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-89lsn" event={"ID":"f882e4ed-c9aa-440d-87a8-067231d28e9f","Type":"ContainerStarted","Data":"8fe9d329a106bacc3d20973e30ebbff21c9153c6b661923f9614db9930435a47"} Jun 10 20:00:13.607886 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.607861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" event={"ID":"3d0820f1-367c-446e-b50a-02dfec4f6532","Type":"ContainerStarted","Data":"dd89fa17d734542d3cca806b49b384af3d0b80f011d39b90b09cb32357fb9227"} Jun 10 20:00:13.620845 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.620798 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-89lsn" podStartSLOduration=2.09224062 podStartE2EDuration="4.620785993s" totalImagesPullingTime="2.528545373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:13.619426539 +0000 UTC m=+38.640056769" watchObservedRunningTime="2026-06-10 20:00:13.620785993 +0000 UTC m=+38.641416223" Jun 10 20:00:13.641398 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.641318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:13.641557 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:13.641422 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:00:13.641557 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:13.641484 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:17.64147125 +0000 UTC m=+42.662101462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:00:13.644333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.644282 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dx9lx" podStartSLOduration=9.897968389999999 podStartE2EDuration="38.644265232s" totalImagesPullingTime="28.746296842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:13.64336368 +0000 UTC m=+38.663993910" watchObservedRunningTime="2026-06-10 20:00:13.644265232 +0000 UTC m=+38.664895463" Jun 10 20:00:13.766655 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.766618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:13.818790 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:13.818759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:14.371946 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:14.371916 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:14.473667 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:14.473639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:14.532494 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:14.532466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:15.260303 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:15.260272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:15.356874 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:15.356843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:17.569687 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:17.569658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:17.570066 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:17.569762 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:00:17.570066 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:17.569774 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:00:17.570066 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:17.569822 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:00:25.569810401 +0000 UTC m=+50.590440609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:00:17.670674 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:17.670645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:17.670845 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:17.670744 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:00:17.670845 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:17.670792 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:25.670779225 +0000 UTC m=+50.691409433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:00:17.923689 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:17.923655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:17.972322 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:17.972291 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:22.498690 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:22.498657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:22.603088 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:22.603057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:25.628980 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:25.628945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:25.629356 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:25.629098 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:00:25.629356 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:25.629117 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:00:25.629356 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:25.629191 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:00:41.629172734 +0000 UTC m=+66.649802963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:00:25.730291 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:25.730258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:25.730463 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:25.730410 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:00:25.730503 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:25.730480 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:41.730464654 +0000 UTC m=+66.751094862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:00:35.247544 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:35.247494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:35.302929 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:35.302896 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:35.583538 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:35.583454 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-666mc" Jun 10 20:00:35.732998 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:35.732965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:35.787573 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:35.787541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:38.429802 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:38.429767 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:38.481397 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:38.481367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:41.134630 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.134584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:41.135156 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.134658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:00:41.137216 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.137196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:00:41.137299 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.137243 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:00:41.145226 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:41.145206 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:00:41.145310 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:41.145274 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 20:01:45.145255007 +0000 UTC m=+130.165885217 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : secret "metrics-daemon-secret" not found Jun 10 20:00:41.148316 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.148295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85650ef3-ec00-46ba-9833-2f7e8c26b5c3-original-pull-secret\") pod \"global-pull-secret-syncer-l728l\" (UID: \"85650ef3-ec00-46ba-9833-2f7e8c26b5c3\") " pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:41.235653 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.235608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:41.238014 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.237996 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:00:41.248613 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.248591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:00:41.259610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.259582 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kstn7\" (UniqueName: \"kubernetes.io/projected/622d9d78-ade0-4b43-b0de-ad409c0ea282-kube-api-access-kstn7\") pod \"network-check-target-j5t2c\" (UID: \"622d9d78-ade0-4b43-b0de-ad409c0ea282\") " pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:41.434088 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.433995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l728l" Jun 10 20:00:41.448407 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.448375 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqgjk\"" Jun 10 20:00:41.456482 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.456460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:41.575187 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.575158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l728l"] Jun 10 20:00:41.577973 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:00:41.577940 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85650ef3_ec00_46ba_9833_2f7e8c26b5c3.slice/crio-4f73a91fa5a6ed96b7418830fd578e86e0842acf3e480f806a1f20890b102759 WatchSource:0}: Error finding container 4f73a91fa5a6ed96b7418830fd578e86e0842acf3e480f806a1f20890b102759: Status 404 returned error can't find the container with id 4f73a91fa5a6ed96b7418830fd578e86e0842acf3e480f806a1f20890b102759 Jun 10 20:00:41.596061 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.596035 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5t2c"] Jun 10 20:00:41.599392 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:00:41.599369 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622d9d78_ade0_4b43_b0de_ad409c0ea282.slice/crio-40e8b1507b2eaafe2560f67f8462ac999976a201df517f06d520775d6508ec78 WatchSource:0}: Error finding container 40e8b1507b2eaafe2560f67f8462ac999976a201df517f06d520775d6508ec78: Status 404 returned error can't find the container with id 40e8b1507b2eaafe2560f67f8462ac999976a201df517f06d520775d6508ec78 Jun 10 20:00:41.639129 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.639102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:00:41.639260 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:41.639245 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:00:41.639311 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:41.639262 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:00:41.639311 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:41.639307 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:01:13.639293587 +0000 UTC m=+98.659923797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:00:41.672450 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.672420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5t2c" event={"ID":"622d9d78-ade0-4b43-b0de-ad409c0ea282","Type":"ContainerStarted","Data":"40e8b1507b2eaafe2560f67f8462ac999976a201df517f06d520775d6508ec78"} Jun 10 20:00:41.673447 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.673426 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l728l" event={"ID":"85650ef3-ec00-46ba-9833-2f7e8c26b5c3","Type":"ContainerStarted","Data":"4f73a91fa5a6ed96b7418830fd578e86e0842acf3e480f806a1f20890b102759"} Jun 10 20:00:41.740016 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:41.739954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:00:41.740124 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:41.740069 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:00:41.740124 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:00:41.740116 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:01:13.740103778 +0000 UTC m=+98.760733987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:00:47.690322 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:47.690280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5t2c" event={"ID":"622d9d78-ade0-4b43-b0de-ad409c0ea282","Type":"ContainerStarted","Data":"621178c4792a1fea4c87a3e99478d8fe174a607e71ad360241cce8f2ab23c0f9"} Jun 10 20:00:47.690751 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:47.690398 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:00:47.691658 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:47.691634 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l728l" event={"ID":"85650ef3-ec00-46ba-9833-2f7e8c26b5c3","Type":"ContainerStarted","Data":"49e70dbdd9b78424b769a39e3b8c0bc731c82ae1b48720c5b154aa2d6fe83cce"} Jun 10 20:00:47.707505 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:47.707469 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j5t2c" podStartSLOduration=67.275780724 podStartE2EDuration="1m12.707458733s" totalImagesPullingTime="5.431678009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:47.706228529 +0000 UTC m=+72.726858753" watchObservedRunningTime="2026-06-10 20:00:47.707458733 +0000 UTC m=+72.728088941" Jun 10 20:00:49.985916 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:49.985871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:00:50.084486 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:00:50.084457 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:01:13.658526 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:01:13.658420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:01:13.658920 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:01:13.658604 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:01:13.658920 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:01:13.658626 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:01:13.658920 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:01:13.658683 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:02:17.658666317 +0000 UTC m=+162.679296530 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:01:13.758977 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:01:13.758947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:01:13.759129 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:01:13.759063 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:01:13.759129 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:01:13.759115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:02:17.759100933 +0000 UTC m=+162.779731144 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:01:18.696606 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:01:18.696575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j5t2c" Jun 10 20:01:18.712251 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:01:18.712199 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l728l" podStartSLOduration=98.258366393 podStartE2EDuration="1m43.712183246s" totalImagesPullingTime="5.453816853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:47.722979429 +0000 UTC m=+72.743609661" watchObservedRunningTime="2026-06-10 20:01:18.712183246 +0000 UTC m=+103.732813477" Jun 10 20:01:45.176192 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:01:45.176156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:01:45.176614 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:01:45.176267 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:01:45.176614 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:01:45.176317 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 20:03:47.176304427 +0000 UTC m=+252.196934637 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : secret "metrics-daemon-secret" not found Jun 10 20:02:12.838058 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:12.838015 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" Jun 10 20:02:12.854159 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:12.854132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zdprg" podUID="de2132a1-d324-4ec6-b2c3-95851da6e9f2" Jun 10 20:02:12.892162 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:02:12.892141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdprg" Jun 10 20:02:12.892280 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:02:12.892141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:02:14.440138 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:14.440098 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:02:17.704938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:02:17.704881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:02:17.705357 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:17.705030 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:02:17.705357 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:17.705051 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f57d48f9b-kmzls: secret "image-registry-tls" not found Jun 10 20:02:17.705357 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:17.705109 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls podName:823d184c-ddba-4a61-a541-9b409a41fbac nodeName:}" failed. No retries permitted until 2026-06-10 20:04:19.705094794 +0000 UTC m=+284.725725007 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls") pod "image-registry-6f57d48f9b-kmzls" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac") : secret "image-registry-tls" not found Jun 10 20:02:17.806082 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:02:17.806031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:02:17.806245 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:17.806177 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:02:17.806245 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:02:17.806235 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls podName:de2132a1-d324-4ec6-b2c3-95851da6e9f2 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:19.806220894 +0000 UTC m=+284.826851107 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls") pod "dns-default-zdprg" (UID: "de2132a1-d324-4ec6-b2c3-95851da6e9f2") : secret "dns-default-metrics-tls" not found Jun 10 20:02:27.418851 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:02:27.418770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:02:31.346703 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:02:31.346668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:02:32.525186 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:02:32.525158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:26.740497 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:26.740467 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:26.793942 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:26.793916 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:28.450744 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.450713 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj"] Jun 10 20:03:28.452651 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.452629 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.454294 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.454271 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5"] Jun 10 20:03:28.454994 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.454975 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 20:03:28.455090 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.455071 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 20:03:28.455155 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.455087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-drjhk\"" Jun 10 20:03:28.455886 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.455871 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.455964 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.455886 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.456093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.456078 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.458243 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.458215 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.458503 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.458486 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 20:03:28.458746 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.458732 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 20:03:28.458798 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.458746 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.458798 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.458763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-46f85\"" Jun 10 20:03:28.463739 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.463722 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj"] Jun 10 20:03:28.467850 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.467829 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85bc74b479-6rjqc"] Jun 10 20:03:28.469481 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.469459 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5"] Jun 10 20:03:28.469587 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.469551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.472145 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.472129 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 20:03:28.472649 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.472629 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 20:03:28.472745 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.472716 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.472745 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.472721 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.472974 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.472948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 20:03:28.473159 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.473146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8x6rq\"" Jun 10 20:03:28.473206 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.473161 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 20:03:28.477599 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.477575 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88"] Jun 10 20:03:28.479282 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.479267 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" Jun 10 20:03:28.482669 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.482650 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.482809 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.482744 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.482903 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.482889 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rhkwb\"" Jun 10 20:03:28.485553 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.485534 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85bc74b479-6rjqc"] Jun 10 20:03:28.490174 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.490156 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88"] Jun 10 20:03:28.546368 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.546334 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm"] Jun 10 20:03:28.548293 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.548278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" Jun 10 20:03:28.550241 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.550226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-sk52w\"" Jun 10 20:03:28.552796 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.552770 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k"] Jun 10 20:03:28.554525 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.554491 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-wgn6w"] Jun 10 20:03:28.554741 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.554619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.556303 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.556287 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf"] Jun 10 20:03:28.556427 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.556412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.557066 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.557042 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.557182 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.557162 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mt6kq\"" Jun 10 20:03:28.558180 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 20:03:28.558180 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558141 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.558180 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558144 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 20:03:28.558411 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558342 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-z4h2m"] Jun 10 20:03:28.558651 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:28.558760 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mkdzz\"" Jun 10 20:03:28.558852 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558594 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.558953 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558879 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.559010 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.558998 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 20:03:28.559094 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.559000 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 20:03:28.560261 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.560243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.560753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.560733 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm"] Jun 10 20:03:28.560979 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.560961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 20:03:28.561061 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.560963 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 20:03:28.561336 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.561320 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lrssq\"" Jun 10 20:03:28.562480 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.562461 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 20:03:28.562590 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.562493 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.562730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.562715 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 20:03:28.562880 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.562864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-v69s6\"" Jun 10 20:03:28.562951 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.562935 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.564480 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.564465 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 20:03:28.568290 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.568268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k"] Jun 10 20:03:28.569105 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.569082 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-wgn6w"] Jun 10 20:03:28.569938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.569921 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 20:03:28.581702 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.581668 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf"] Jun 10 20:03:28.582814 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.582794 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-z4h2m"] Jun 10 20:03:28.585630 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-config\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.585746 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433db650-5114-4e11-997a-4c3e144c8dd8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.585746 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433db650-5114-4e11-997a-4c3e144c8dd8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.585746 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpg28\" (UniqueName: \"kubernetes.io/projected/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-kube-api-access-wpg28\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.585914 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.585914 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-stats-auth\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.585914 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d9n6\" (UniqueName: \"kubernetes.io/projected/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-kube-api-access-9d9n6\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.585914 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-default-certificate\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.586135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb244\" (UniqueName: \"kubernetes.io/projected/fc17413c-8866-445d-b4d6-8a6192fa596e-kube-api-access-jb244\") pod \"volume-data-source-validator-78dd696465-n6d88\" (UID: \"fc17413c-8866-445d-b4d6-8a6192fa596e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" Jun 10 20:03:28.586135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.586135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.585973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.586135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.586010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8qh9\" (UniqueName: \"kubernetes.io/projected/433db650-5114-4e11-997a-4c3e144c8dd8-kube-api-access-d8qh9\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.648575 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.648547 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t"] Jun 10 20:03:28.650523 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.650498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:28.652775 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.652753 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:03:28.652775 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.652767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 20:03:28.653084 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.653066 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m5q5f\"" Jun 10 20:03:28.653172 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.653158 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 20:03:28.661988 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.661968 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t"] Jun 10 20:03:28.687241 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-serving-cert\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.687343 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-trusted-ca\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.687343 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e998891-ddc5-461c-b095-9f6d037029b9-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.687343 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-default-certificate\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.687343 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:28.687475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb244\" (UniqueName: \"kubernetes.io/projected/fc17413c-8866-445d-b4d6-8a6192fa596e-kube-api-access-jb244\") pod \"volume-data-source-validator-78dd696465-n6d88\" (UID: \"fc17413c-8866-445d-b4d6-8a6192fa596e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" Jun 10 20:03:28.687475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.687475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpg28\" (UniqueName: \"kubernetes.io/projected/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-kube-api-access-wpg28\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.687475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a573eda-5cdd-429d-b055-471a3b333114-trusted-ca-bundle\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.687475 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.687772 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-config\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.687772 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d9n6\" (UniqueName: \"kubernetes.io/projected/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-kube-api-access-9d9n6\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.687772 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.687577 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:03:28.687772 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98a3a1d2-1842-453d-9cfb-b365a65a2468-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:28.687772 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-stats-auth\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.687772 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7jk\" (UniqueName: \"kubernetes.io/projected/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-kube-api-access-2x7jk\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.687772 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.687693 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:29.18767287 +0000 UTC m=+234.208303096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : secret "router-metrics-certs-default" not found Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a573eda-5cdd-429d-b055-471a3b333114-tmp\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfd9x\" (UniqueName: \"kubernetes.io/projected/d3f4fb8d-2847-40f0-a7ed-1eca6e168439-kube-api-access-wfd9x\") pod \"network-check-source-dbd9cf844-78gtm\" (UID: \"d3f4fb8d-2847-40f0-a7ed-1eca6e168439\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a573eda-5cdd-429d-b055-471a3b333114-snapshots\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpskg\" (UniqueName: \"kubernetes.io/projected/8e998891-ddc5-461c-b095-9f6d037029b9-kube-api-access-lpskg\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.687943 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:29.187927112 +0000 UTC m=+234.208557332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : configmap references non-existent config key: service-ca.crt Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.687996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a573eda-5cdd-429d-b055-471a3b333114-service-ca-bundle\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9jw\" (UniqueName: \"kubernetes.io/projected/3a573eda-5cdd-429d-b055-471a3b333114-kube-api-access-7c9jw\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8qh9\" (UniqueName: \"kubernetes.io/projected/433db650-5114-4e11-997a-4c3e144c8dd8-kube-api-access-d8qh9\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-config\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.688089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-config\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.688779 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a573eda-5cdd-429d-b055-471a3b333114-serving-cert\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.688779 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433db650-5114-4e11-997a-4c3e144c8dd8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.688779 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433db650-5114-4e11-997a-4c3e144c8dd8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.688943 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.688803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/433db650-5114-4e11-997a-4c3e144c8dd8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.690048 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.690022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-default-certificate\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.690139 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.690063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.690208 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.690148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-stats-auth\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.690303 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.690286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/433db650-5114-4e11-997a-4c3e144c8dd8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.693406 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.693366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:28.695586 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.695563 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpg28\" (UniqueName: \"kubernetes.io/projected/2968f6c9-e5c2-4074-b9b0-106fd382cc1b-kube-api-access-wpg28\") pod \"service-ca-operator-6bc5ff68f5-p85d5\" (UID: \"2968f6c9-e5c2-4074-b9b0-106fd382cc1b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.695970 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.695615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d9n6\" (UniqueName: \"kubernetes.io/projected/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-kube-api-access-9d9n6\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:28.696814 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.696762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb244\" (UniqueName: \"kubernetes.io/projected/fc17413c-8866-445d-b4d6-8a6192fa596e-kube-api-access-jb244\") pod \"volume-data-source-validator-78dd696465-n6d88\" (UID: \"fc17413c-8866-445d-b4d6-8a6192fa596e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" Jun 10 20:03:28.697113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.697034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8qh9\" (UniqueName: \"kubernetes.io/projected/433db650-5114-4e11-997a-4c3e144c8dd8-kube-api-access-d8qh9\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-6c2zj\" (UID: \"433db650-5114-4e11-997a-4c3e144c8dd8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.763201 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.763116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" Jun 10 20:03:28.768796 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.768775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" Jun 10 20:03:28.787720 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.787662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" Jun 10 20:03:28.789202 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-serving-cert\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.789324 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-trusted-ca\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.789324 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e998891-ddc5-461c-b095-9f6d037029b9-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.789324 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:28.789324 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a573eda-5cdd-429d-b055-471a3b333114-trusted-ca-bundle\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.789554 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.789554 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:28.789554 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98a3a1d2-1842-453d-9cfb-b365a65a2468-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:28.789554 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7jk\" (UniqueName: \"kubernetes.io/projected/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-kube-api-access-2x7jk\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.789554 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a573eda-5cdd-429d-b055-471a3b333114-tmp\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.789554 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfd9x\" (UniqueName: \"kubernetes.io/projected/d3f4fb8d-2847-40f0-a7ed-1eca6e168439-kube-api-access-wfd9x\") pod \"network-check-source-dbd9cf844-78gtm\" (UID: \"d3f4fb8d-2847-40f0-a7ed-1eca6e168439\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" Jun 10 20:03:28.790032 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a573eda-5cdd-429d-b055-471a3b333114-snapshots\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.790032 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmrkg\" (UniqueName: \"kubernetes.io/projected/d5c2aaec-9cf8-453c-ac65-c149d5952e32-kube-api-access-nmrkg\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:28.790032 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpskg\" (UniqueName: \"kubernetes.io/projected/8e998891-ddc5-461c-b095-9f6d037029b9-kube-api-access-lpskg\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.790032 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a573eda-5cdd-429d-b055-471a3b333114-service-ca-bundle\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.790032 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9jw\" (UniqueName: \"kubernetes.io/projected/3a573eda-5cdd-429d-b055-471a3b333114-kube-api-access-7c9jw\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.790032 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-config\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.790032 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.789747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a573eda-5cdd-429d-b055-471a3b333114-serving-cert\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.790368 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.790130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8e998891-ddc5-461c-b095-9f6d037029b9-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.790368 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.790303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-trusted-ca\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.790465 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.790403 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:28.790465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.790418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a573eda-5cdd-429d-b055-471a3b333114-tmp\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.790587 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.790486 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls podName:8e998891-ddc5-461c-b095-9f6d037029b9 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:29.290468062 +0000 UTC m=+234.311098275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m977k" (UID: "8e998891-ddc5-461c-b095-9f6d037029b9") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:28.790587 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.790572 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:03:28.790696 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.790611 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert podName:98a3a1d2-1842-453d-9cfb-b365a65a2468 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:29.290597213 +0000 UTC m=+234.311227422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zm2xf" (UID: "98a3a1d2-1842-453d-9cfb-b365a65a2468") : secret "networking-console-plugin-cert" not found Jun 10 20:03:28.791106 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.791072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98a3a1d2-1842-453d-9cfb-b365a65a2468-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:28.791268 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.791223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3a573eda-5cdd-429d-b055-471a3b333114-snapshots\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.791398 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.791377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a573eda-5cdd-429d-b055-471a3b333114-trusted-ca-bundle\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.791966 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.791942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a573eda-5cdd-429d-b055-471a3b333114-service-ca-bundle\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.791966 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.791968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-config\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.792296 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.792280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-serving-cert\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.792452 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.792433 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a573eda-5cdd-429d-b055-471a3b333114-serving-cert\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.794028 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.794005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:28.798893 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.798561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfd9x\" (UniqueName: \"kubernetes.io/projected/d3f4fb8d-2847-40f0-a7ed-1eca6e168439-kube-api-access-wfd9x\") pod \"network-check-source-dbd9cf844-78gtm\" (UID: \"d3f4fb8d-2847-40f0-a7ed-1eca6e168439\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" Jun 10 20:03:28.798893 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.798829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpskg\" (UniqueName: \"kubernetes.io/projected/8e998891-ddc5-461c-b095-9f6d037029b9-kube-api-access-lpskg\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:28.799628 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.799608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7jk\" (UniqueName: \"kubernetes.io/projected/070cc251-fe8e-4d1b-b27f-d8b96ca2943b-kube-api-access-2x7jk\") pod \"console-operator-668fdbf85c-z4h2m\" (UID: \"070cc251-fe8e-4d1b-b27f-d8b96ca2943b\") " pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.800184 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.800168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9jw\" (UniqueName: \"kubernetes.io/projected/3a573eda-5cdd-429d-b055-471a3b333114-kube-api-access-7c9jw\") pod \"insights-operator-896549976-wgn6w\" (UID: \"3a573eda-5cdd-429d-b055-471a3b333114\") " pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.860017 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.858947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" Jun 10 20:03:28.875049 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.874821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-wgn6w" Jun 10 20:03:28.886457 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.886431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:28.890991 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.890774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:28.890991 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.890849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmrkg\" (UniqueName: \"kubernetes.io/projected/d5c2aaec-9cf8-453c-ac65-c149d5952e32-kube-api-access-nmrkg\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:28.890991 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.890949 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:03:28.891183 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:28.891022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls podName:d5c2aaec-9cf8-453c-ac65-c149d5952e32 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:29.391000702 +0000 UTC m=+234.411630928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4wx2t" (UID: "d5c2aaec-9cf8-453c-ac65-c149d5952e32") : secret "samples-operator-tls" not found Jun 10 20:03:28.901969 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.901894 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmrkg\" (UniqueName: \"kubernetes.io/projected/d5c2aaec-9cf8-453c-ac65-c149d5952e32-kube-api-access-nmrkg\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:28.904630 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.903699 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj"] Jun 10 20:03:28.934268 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.934191 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5"] Jun 10 20:03:28.938908 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:03:28.938874 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2968f6c9_e5c2_4074_b9b0_106fd382cc1b.slice/crio-9640e28b9b4eb9138a5c8a8d313ebc6c61098071c3aae732867baa22fa27c36b WatchSource:0}: Error finding container 9640e28b9b4eb9138a5c8a8d313ebc6c61098071c3aae732867baa22fa27c36b: Status 404 returned error can't find the container with id 9640e28b9b4eb9138a5c8a8d313ebc6c61098071c3aae732867baa22fa27c36b Jun 10 20:03:28.961601 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:28.961170 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88"] Jun 10 20:03:28.964172 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:03:28.964130 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc17413c_8866_445d_b4d6_8a6192fa596e.slice/crio-aacaa5276e9e5823f8ac2b0089d8d521defda413dc8799b05cc23ef7c300cf18 WatchSource:0}: Error finding container aacaa5276e9e5823f8ac2b0089d8d521defda413dc8799b05cc23ef7c300cf18: Status 404 returned error can't find the container with id aacaa5276e9e5823f8ac2b0089d8d521defda413dc8799b05cc23ef7c300cf18 Jun 10 20:03:29.016960 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.016930 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm"] Jun 10 20:03:29.020143 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:03:29.020110 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f4fb8d_2847_40f0_a7ed_1eca6e168439.slice/crio-fea057a882d8da09b6b063f0462c756e55518904d59af1f0d34992604232a95c WatchSource:0}: Error finding container fea057a882d8da09b6b063f0462c756e55518904d59af1f0d34992604232a95c: Status 404 returned error can't find the container with id fea057a882d8da09b6b063f0462c756e55518904d59af1f0d34992604232a95c Jun 10 20:03:29.032739 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.032714 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-wgn6w"] Jun 10 20:03:29.036046 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:03:29.036021 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a573eda_5cdd_429d_b055_471a3b333114.slice/crio-e647a0346c7a0baac6dc5e054b30491ad88284fc448307664921cf1d099e3052 WatchSource:0}: Error finding container e647a0346c7a0baac6dc5e054b30491ad88284fc448307664921cf1d099e3052: Status 404 returned error can't find the container with id e647a0346c7a0baac6dc5e054b30491ad88284fc448307664921cf1d099e3052 Jun 10 20:03:29.050932 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.050907 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-z4h2m"] Jun 10 20:03:29.053387 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:03:29.053365 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070cc251_fe8e_4d1b_b27f_d8b96ca2943b.slice/crio-e4f75fca565ba935c9afe1629faee9cd4f37550c1e301ba27089915fb7deb197 WatchSource:0}: Error finding container e4f75fca565ba935c9afe1629faee9cd4f37550c1e301ba27089915fb7deb197: Status 404 returned error can't find the container with id e4f75fca565ba935c9afe1629faee9cd4f37550c1e301ba27089915fb7deb197 Jun 10 20:03:29.061243 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.061222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" event={"ID":"070cc251-fe8e-4d1b-b27f-d8b96ca2943b","Type":"ContainerStarted","Data":"e4f75fca565ba935c9afe1629faee9cd4f37550c1e301ba27089915fb7deb197"} Jun 10 20:03:29.062297 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.062272 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" event={"ID":"fc17413c-8866-445d-b4d6-8a6192fa596e","Type":"ContainerStarted","Data":"aacaa5276e9e5823f8ac2b0089d8d521defda413dc8799b05cc23ef7c300cf18"} Jun 10 20:03:29.063307 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.063278 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" event={"ID":"2968f6c9-e5c2-4074-b9b0-106fd382cc1b","Type":"ContainerStarted","Data":"9640e28b9b4eb9138a5c8a8d313ebc6c61098071c3aae732867baa22fa27c36b"} Jun 10 20:03:29.064270 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.064244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" event={"ID":"d3f4fb8d-2847-40f0-a7ed-1eca6e168439","Type":"ContainerStarted","Data":"fea057a882d8da09b6b063f0462c756e55518904d59af1f0d34992604232a95c"} Jun 10 20:03:29.065300 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.065279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wgn6w" event={"ID":"3a573eda-5cdd-429d-b055-471a3b333114","Type":"ContainerStarted","Data":"e647a0346c7a0baac6dc5e054b30491ad88284fc448307664921cf1d099e3052"} Jun 10 20:03:29.066274 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.066256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" event={"ID":"433db650-5114-4e11-997a-4c3e144c8dd8","Type":"ContainerStarted","Data":"4235e30d881edefc5de48cda9052882bf30c71478e65428f2c7029e775184ebc"} Jun 10 20:03:29.193223 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.193187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:29.193382 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.193334 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:03:29.193382 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.193366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:29.193452 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.193397 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:30.193377791 +0000 UTC m=+235.214008019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : secret "router-metrics-certs-default" not found Jun 10 20:03:29.193496 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.193466 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:30.193451135 +0000 UTC m=+235.214081348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : configmap references non-existent config key: service-ca.crt Jun 10 20:03:29.294737 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.294659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:29.294737 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.294704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:29.294918 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.294829 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:03:29.294918 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.294865 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:29.294918 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.294902 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert podName:98a3a1d2-1842-453d-9cfb-b365a65a2468 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:30.294883807 +0000 UTC m=+235.315514021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zm2xf" (UID: "98a3a1d2-1842-453d-9cfb-b365a65a2468") : secret "networking-console-plugin-cert" not found Jun 10 20:03:29.295020 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.294920 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls podName:8e998891-ddc5-461c-b095-9f6d037029b9 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:30.294910911 +0000 UTC m=+235.315541124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m977k" (UID: "8e998891-ddc5-461c-b095-9f6d037029b9") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:29.395539 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:29.395491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:29.395688 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.395634 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:03:29.395759 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:29.395710 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls podName:d5c2aaec-9cf8-453c-ac65-c149d5952e32 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:30.395689354 +0000 UTC m=+235.416319576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4wx2t" (UID: "d5c2aaec-9cf8-453c-ac65-c149d5952e32") : secret "samples-operator-tls" not found Jun 10 20:03:30.074193 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:30.073966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" event={"ID":"d3f4fb8d-2847-40f0-a7ed-1eca6e168439","Type":"ContainerStarted","Data":"7728b67fc2031035cceae91ffe5c0c2794fa10381188791a4a76c3832c4c4496"} Jun 10 20:03:30.090875 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:30.090349 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-78gtm" podStartSLOduration=2.090328477 podStartE2EDuration="2.090328477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:30.088774103 +0000 UTC m=+235.109404336" watchObservedRunningTime="2026-06-10 20:03:30.090328477 +0000 UTC m=+235.110958722" Jun 10 20:03:30.203113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:30.202033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:30.203113 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:30.202152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:30.203113 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.202278 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:03:30.203113 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.202338 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:32.202320476 +0000 UTC m=+237.222950691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : secret "router-metrics-certs-default" not found Jun 10 20:03:30.203113 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.203070 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:32.203052509 +0000 UTC m=+237.223682720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : configmap references non-existent config key: service-ca.crt Jun 10 20:03:30.303467 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:30.303428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:30.303661 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:30.303500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:30.303661 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.303624 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:03:30.303781 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.303689 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert podName:98a3a1d2-1842-453d-9cfb-b365a65a2468 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:32.303671223 +0000 UTC m=+237.324301436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zm2xf" (UID: "98a3a1d2-1842-453d-9cfb-b365a65a2468") : secret "networking-console-plugin-cert" not found Jun 10 20:03:30.303781 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.303698 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:30.303781 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.303733 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls podName:8e998891-ddc5-461c-b095-9f6d037029b9 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:32.303724267 +0000 UTC m=+237.324354477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m977k" (UID: "8e998891-ddc5-461c-b095-9f6d037029b9") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:30.404643 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:30.404611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:30.404901 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.404884 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:03:30.404993 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:30.404944 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls podName:d5c2aaec-9cf8-453c-ac65-c149d5952e32 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:32.404927499 +0000 UTC m=+237.425557712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4wx2t" (UID: "d5c2aaec-9cf8-453c-ac65-c149d5952e32") : secret "samples-operator-tls" not found Jun 10 20:03:31.078988 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:31.078922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" event={"ID":"fc17413c-8866-445d-b4d6-8a6192fa596e","Type":"ContainerStarted","Data":"21dc7ca2f9ff78155b670b90a90ad093569c14b4d3c72f5c7022458c039498d3"} Jun 10 20:03:31.096436 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:31.096387 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-n6d88" podStartSLOduration=1.542697679 podStartE2EDuration="3.096368051s" totalImagesPullingTime="1.553670372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:31.095321586 +0000 UTC m=+236.115951818" watchObservedRunningTime="2026-06-10 20:03:31.096368051 +0000 UTC m=+236.116998290" Jun 10 20:03:31.200186 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:31.200153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:31.301929 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:31.301889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:32.221130 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:32.221100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:32.221587 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:32.221311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:32.221587 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.221446 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:36.221423833 +0000 UTC m=+241.242054049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : configmap references non-existent config key: service-ca.crt Jun 10 20:03:32.221587 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.221480 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:03:32.221587 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.221550 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:36.221530008 +0000 UTC m=+241.242160235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : secret "router-metrics-certs-default" not found Jun 10 20:03:32.322668 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:32.322579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:32.322668 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:32.322654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:32.322870 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.322687 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:03:32.322870 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.322760 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert podName:98a3a1d2-1842-453d-9cfb-b365a65a2468 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:36.322741713 +0000 UTC m=+241.343371932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zm2xf" (UID: "98a3a1d2-1842-453d-9cfb-b365a65a2468") : secret "networking-console-plugin-cert" not found Jun 10 20:03:32.322870 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.322766 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:32.322870 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.322818 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls podName:8e998891-ddc5-461c-b095-9f6d037029b9 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:36.322803355 +0000 UTC m=+241.343433564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m977k" (UID: "8e998891-ddc5-461c-b095-9f6d037029b9") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:32.423930 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:32.423897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:32.424093 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.424057 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:03:32.424152 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:32.424133 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls podName:d5c2aaec-9cf8-453c-ac65-c149d5952e32 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:36.42411352 +0000 UTC m=+241.444743743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4wx2t" (UID: "d5c2aaec-9cf8-453c-ac65-c149d5952e32") : secret "samples-operator-tls" not found Jun 10 20:03:33.086294 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:33.086251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wgn6w" event={"ID":"3a573eda-5cdd-429d-b055-471a3b333114","Type":"ContainerStarted","Data":"1117dca198e8aa7d0a1df7027d41d506dd16324bc63e8f3b5d220fae302a1756"} Jun 10 20:03:33.088148 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:33.088117 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/0.log" Jun 10 20:03:33.088280 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:33.088163 2578 generic.go:356] "Generic (PLEG): container finished" podID="070cc251-fe8e-4d1b-b27f-d8b96ca2943b" containerID="ea329594a7837e5faf2590241d0187dfaeec43625ac81bb7698226f2492c0bc4" exitCode=255 Jun 10 20:03:33.088280 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:33.088225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" event={"ID":"070cc251-fe8e-4d1b-b27f-d8b96ca2943b","Type":"ContainerDied","Data":"ea329594a7837e5faf2590241d0187dfaeec43625ac81bb7698226f2492c0bc4"} Jun 10 20:03:33.088595 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:33.088500 2578 scope.go:117] "RemoveContainer" containerID="ea329594a7837e5faf2590241d0187dfaeec43625ac81bb7698226f2492c0bc4" Jun 10 20:03:33.103087 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:33.103044 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-wgn6w" podStartSLOduration=2.078081256 podStartE2EDuration="5.103029244s" totalImagesPullingTime="3.024947988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:33.101880877 +0000 UTC m=+238.122511109" watchObservedRunningTime="2026-06-10 20:03:33.103029244 +0000 UTC m=+238.123659475" Jun 10 20:03:33.253408 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:33.252872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:34.093328 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.093293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" event={"ID":"433db650-5114-4e11-997a-4c3e144c8dd8","Type":"ContainerStarted","Data":"34322ca235e0b538dbeed245dfce954bf39224c3e74b141472d47ce19f20c678"} Jun 10 20:03:34.094855 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.094832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:03:34.095229 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.095216 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/0.log" Jun 10 20:03:34.095292 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.095245 2578 generic.go:356] "Generic (PLEG): container finished" podID="070cc251-fe8e-4d1b-b27f-d8b96ca2943b" containerID="4d09df4de49cf6e5bccc8e83f1aa8f43a6f3b517c2231f63194630cfbdec3091" exitCode=255 Jun 10 20:03:34.095326 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.095305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" event={"ID":"070cc251-fe8e-4d1b-b27f-d8b96ca2943b","Type":"ContainerDied","Data":"4d09df4de49cf6e5bccc8e83f1aa8f43a6f3b517c2231f63194630cfbdec3091"} Jun 10 20:03:34.095373 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.095349 2578 scope.go:117] "RemoveContainer" containerID="ea329594a7837e5faf2590241d0187dfaeec43625ac81bb7698226f2492c0bc4" Jun 10 20:03:34.095552 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.095536 2578 scope.go:117] "RemoveContainer" containerID="4d09df4de49cf6e5bccc8e83f1aa8f43a6f3b517c2231f63194630cfbdec3091" Jun 10 20:03:34.095729 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:34.095707 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-z4h2m_openshift-console-operator(070cc251-fe8e-4d1b-b27f-d8b96ca2943b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" podUID="070cc251-fe8e-4d1b-b27f-d8b96ca2943b" Jun 10 20:03:34.097080 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.097058 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" event={"ID":"2968f6c9-e5c2-4074-b9b0-106fd382cc1b","Type":"ContainerStarted","Data":"65c21e0d63fb4927d280d52069ef0699fbf8fbb3beb9b9bf59defc171ddb8e05"} Jun 10 20:03:34.107685 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.107644 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" podStartSLOduration=1.8754534980000002 podStartE2EDuration="6.107620915s" totalImagesPullingTime="4.232167417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:34.107485628 +0000 UTC m=+239.128115869" watchObservedRunningTime="2026-06-10 20:03:34.107620915 +0000 UTC m=+239.128251148" Jun 10 20:03:34.123119 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:34.123072 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" podStartSLOduration=1.155746077 podStartE2EDuration="6.123058946s" totalImagesPullingTime="4.967312869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:34.122568372 +0000 UTC m=+239.143198604" watchObservedRunningTime="2026-06-10 20:03:34.123058946 +0000 UTC m=+239.143689216" Jun 10 20:03:35.101862 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.101832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:03:35.102335 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.102299 2578 scope.go:117] "RemoveContainer" containerID="4d09df4de49cf6e5bccc8e83f1aa8f43a6f3b517c2231f63194630cfbdec3091" Jun 10 20:03:35.102462 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:35.102444 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-z4h2m_openshift-console-operator(070cc251-fe8e-4d1b-b27f-d8b96ca2943b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" podUID="070cc251-fe8e-4d1b-b27f-d8b96ca2943b" Jun 10 20:03:35.222253 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.222216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:35.287374 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.287337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:35.344804 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.344773 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:35.375737 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.375670 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w7q6n_94f990e9-05a4-48c2-aad9-d0075b23cab3/dns-node-resolver/0.log" Jun 10 20:03:35.589420 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.589381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:35.975331 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:35.975301 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cvmnq_fe70f0ef-e304-49e3-8be4-b449289a587c/node-ca/0.log" Jun 10 20:03:36.023005 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.022973 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:36.075335 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.075309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:36.263576 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.263488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:36.263928 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.263588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:36.263928 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.263610 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:03:36.263928 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.263668 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:44.263653304 +0000 UTC m=+249.284283513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : secret "router-metrics-certs-default" not found Jun 10 20:03:36.263928 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.263736 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:44.263721898 +0000 UTC m=+249.284352111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : configmap references non-existent config key: service-ca.crt Jun 10 20:03:36.306563 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.306533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:36.364757 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.364729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:36.364897 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.364836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:36.364976 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.364899 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:36.364976 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.364916 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:03:36.364976 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.364962 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert podName:98a3a1d2-1842-453d-9cfb-b365a65a2468 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:44.364949933 +0000 UTC m=+249.385580143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zm2xf" (UID: "98a3a1d2-1842-453d-9cfb-b365a65a2468") : secret "networking-console-plugin-cert" not found Jun 10 20:03:36.364976 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.364975 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls podName:8e998891-ddc5-461c-b095-9f6d037029b9 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:44.364969058 +0000 UTC m=+249.385599267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m977k" (UID: "8e998891-ddc5-461c-b095-9f6d037029b9") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:36.406034 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.405998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:36.466194 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.466162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:36.466344 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.466295 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 20:03:36.466390 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:36.466351 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls podName:d5c2aaec-9cf8-453c-ac65-c149d5952e32 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:44.466338205 +0000 UTC m=+249.486968414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-4wx2t" (UID: "d5c2aaec-9cf8-453c-ac65-c149d5952e32") : secret "samples-operator-tls" not found Jun 10 20:03:36.776266 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:36.776241 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-89lsn_f882e4ed-c9aa-440d-87a8-067231d28e9f/serve-healthcheck-canary/0.log" Jun 10 20:03:37.930876 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:37.930852 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:37.989394 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:37.989354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:38.090587 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:38.090535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:38.887273 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:38.887225 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:38.887427 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:38.887293 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:38.887639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:38.887627 2578 scope.go:117] "RemoveContainer" containerID="4d09df4de49cf6e5bccc8e83f1aa8f43a6f3b517c2231f63194630cfbdec3091" Jun 10 20:03:38.887783 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:38.887765 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-z4h2m_openshift-console-operator(070cc251-fe8e-4d1b-b27f-d8b96ca2943b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" podUID="070cc251-fe8e-4d1b-b27f-d8b96ca2943b" Jun 10 20:03:38.957371 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:38.957340 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:41.228895 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:41.228852 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:41.562561 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:41.562451 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:41.847446 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:41.847415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:41.950769 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:41.950734 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:42.098174 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:42.098086 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:42.178061 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:42.178032 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:42.277973 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:42.277930 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:43.463876 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:43.463848 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:43.657024 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:43.656998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:43.857530 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:43.857483 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:44.058355 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.058302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:44.263021 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.262928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:44.328311 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.328265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:44.328463 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.328379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:03:44.328463 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:44.328423 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 20:03:44.328546 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:44.328485 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:00.32847233 +0000 UTC m=+265.349102540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : secret "router-metrics-certs-default" not found Jun 10 20:03:44.328627 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:44.328557 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle podName:6ad4d49a-f4c2-4a5d-a033-4a74b563dd00 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:00.328539139 +0000 UTC m=+265.349169349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle") pod "router-default-85bc74b479-6rjqc" (UID: "6ad4d49a-f4c2-4a5d-a033-4a74b563dd00") : configmap references non-existent config key: service-ca.crt Jun 10 20:03:44.429046 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.429012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:03:44.429193 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.429117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:03:44.429193 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:44.429171 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:44.429303 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:44.429200 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:03:44.429303 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:44.429234 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls podName:8e998891-ddc5-461c-b095-9f6d037029b9 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:00.429218852 +0000 UTC m=+265.449849061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-m977k" (UID: "8e998891-ddc5-461c-b095-9f6d037029b9") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:03:44.429303 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:44.429254 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert podName:98a3a1d2-1842-453d-9cfb-b365a65a2468 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:00.429241513 +0000 UTC m=+265.449871722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-zm2xf" (UID: "98a3a1d2-1842-453d-9cfb-b365a65a2468") : secret "networking-console-plugin-cert" not found Jun 10 20:03:44.529884 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.529799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:44.532084 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.532063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c2aaec-9cf8-453c-ac65-c149d5952e32-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-4wx2t\" (UID: \"d5c2aaec-9cf8-453c-ac65-c149d5952e32\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:44.561582 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.561554 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m5q5f\"" Jun 10 20:03:44.569384 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.569366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" Jun 10 20:03:44.686123 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:44.686062 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t"] Jun 10 20:03:45.056243 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:45.056212 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:45.132601 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:45.132572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" event={"ID":"d5c2aaec-9cf8-453c-ac65-c149d5952e32","Type":"ContainerStarted","Data":"f4ebedf88b6dad201b25d2d088572cfb94397d5b8ff6dd70c84573cf954e3510"} Jun 10 20:03:45.457823 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:45.457788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:45.558088 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:45.558055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:45.658549 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:45.658497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:45.866244 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:45.866219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:46.248925 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:46.248849 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:46.298322 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:46.298293 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:46.460714 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:46.460674 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:47.061332 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:47.061296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:47.139885 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:47.139854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" event={"ID":"d5c2aaec-9cf8-453c-ac65-c149d5952e32","Type":"ContainerStarted","Data":"b1c62ba730a4f69f7e95e1b207a75ba929e85d50e85a02844d081c093a2e9c30"} Jun 10 20:03:47.140003 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:47.139957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" event={"ID":"d5c2aaec-9cf8-453c-ac65-c149d5952e32","Type":"ContainerStarted","Data":"29f292622a5f7596b33cfd8654b08bad902497d945a6edd2689c30b26f994419"} Jun 10 20:03:47.155937 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:47.155888 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-4wx2t" podStartSLOduration=16.896060178 podStartE2EDuration="19.155873111s" totalImagesPullingTime="2.259812933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:47.154810785 +0000 UTC m=+252.175441017" watchObservedRunningTime="2026-06-10 20:03:47.155873111 +0000 UTC m=+252.176503373" Jun 10 20:03:47.253913 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:47.253831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:03:47.254049 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:47.253938 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:03:47.254049 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:03:47.253997 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs podName:4fecdbed-8e45-464d-88fd-5fd129de2e4a nodeName:}" failed. No retries permitted until 2026-06-10 20:05:49.25398334 +0000 UTC m=+374.274613549 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs") pod "network-metrics-daemon-mkwx6" (UID: "4fecdbed-8e45-464d-88fd-5fd129de2e4a") : secret "metrics-daemon-secret" not found Jun 10 20:03:47.660385 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:47.660347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:47.859582 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:47.859552 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:48.060069 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:48.059988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:48.110371 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:48.110340 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:48.262526 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:48.262479 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:49.260238 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:49.260207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:49.419732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:49.419700 2578 scope.go:117] "RemoveContainer" containerID="4d09df4de49cf6e5bccc8e83f1aa8f43a6f3b517c2231f63194630cfbdec3091" Jun 10 20:03:49.461904 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:49.461884 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:49.865279 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:49.865250 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.066817 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.066788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.118548 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.118454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.151985 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.151956 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:03:50.152162 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.152056 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" event={"ID":"070cc251-fe8e-4d1b-b27f-d8b96ca2943b","Type":"ContainerStarted","Data":"b34f49a3f9defbd755dc7f9987d2276de79b393095fa3b3fe5673a61e885b86b"} Jun 10 20:03:50.152369 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.152332 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:50.159529 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.159478 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" Jun 10 20:03:50.168998 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.168945 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-z4h2m" podStartSLOduration=19.159805235 podStartE2EDuration="22.168927276s" totalImagesPullingTime="3.009122041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:50.16783768 +0000 UTC m=+255.188467924" watchObservedRunningTime="2026-06-10 20:03:50.168927276 +0000 UTC m=+255.189557507" Jun 10 20:03:50.322631 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.322598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.427802 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.427722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.488395 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.488361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.576910 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.576877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.677601 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.677568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.801500 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.801423 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:50.982575 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:50.982548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:51.082916 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:51.082844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:51.144025 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:51.144001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:51.382629 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:51.382597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:51.483589 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:51.483560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:51.859254 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:51.859227 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:51.991736 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:51.991708 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:52.054857 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:52.054827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:52.201880 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:52.201804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:52.301640 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:52.301610 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:52.660869 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:52.660840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:52.813236 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:52.813206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:52.914575 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:52.914484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:53.368397 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:53.368369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:53.420152 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:53.420127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:58.707681 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.707611 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-44ff4"] Jun 10 20:03:58.709814 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.709797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.712499 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.712477 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 20:03:58.712850 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.712832 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 20:03:58.713348 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.713326 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hf687\"" Jun 10 20:03:58.726816 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.726794 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44ff4"] Jun 10 20:03:58.745542 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.745492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e11a4a4b-439b-4d27-892f-50dd2106bfa1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.745651 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.745623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e11a4a4b-439b-4d27-892f-50dd2106bfa1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.745689 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.745674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e11a4a4b-439b-4d27-892f-50dd2106bfa1-data-volume\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.745760 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.745748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpjrd\" (UniqueName: \"kubernetes.io/projected/e11a4a4b-439b-4d27-892f-50dd2106bfa1-kube-api-access-vpjrd\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.745794 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.745775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e11a4a4b-439b-4d27-892f-50dd2106bfa1-crio-socket\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.799875 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.799845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:58.846376 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.846347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e11a4a4b-439b-4d27-892f-50dd2106bfa1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.846553 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.846396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e11a4a4b-439b-4d27-892f-50dd2106bfa1-data-volume\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.846553 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.846455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpjrd\" (UniqueName: \"kubernetes.io/projected/e11a4a4b-439b-4d27-892f-50dd2106bfa1-kube-api-access-vpjrd\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.846553 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.846476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e11a4a4b-439b-4d27-892f-50dd2106bfa1-crio-socket\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.846553 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.846496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e11a4a4b-439b-4d27-892f-50dd2106bfa1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.846736 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.846606 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e11a4a4b-439b-4d27-892f-50dd2106bfa1-crio-socket\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.846830 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.846805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e11a4a4b-439b-4d27-892f-50dd2106bfa1-data-volume\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.847085 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.847036 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e11a4a4b-439b-4d27-892f-50dd2106bfa1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.848643 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.848624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e11a4a4b-439b-4d27-892f-50dd2106bfa1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.856321 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.856297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpjrd\" (UniqueName: \"kubernetes.io/projected/e11a4a4b-439b-4d27-892f-50dd2106bfa1-kube-api-access-vpjrd\") pod \"insights-runtime-extractor-44ff4\" (UID: \"e11a4a4b-439b-4d27-892f-50dd2106bfa1\") " pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:58.874857 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:58.874838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:03:59.018738 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:59.018667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44ff4" Jun 10 20:03:59.141797 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:59.141764 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44ff4"] Jun 10 20:03:59.144392 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:03:59.144366 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11a4a4b_439b_4d27_892f_50dd2106bfa1.slice/crio-ae384bb99dab07c624c4c535e548bc90367e23e736882453ea1f897e501ed911 WatchSource:0}: Error finding container ae384bb99dab07c624c4c535e548bc90367e23e736882453ea1f897e501ed911: Status 404 returned error can't find the container with id ae384bb99dab07c624c4c535e548bc90367e23e736882453ea1f897e501ed911 Jun 10 20:03:59.181336 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:03:59.181310 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44ff4" event={"ID":"e11a4a4b-439b-4d27-892f-50dd2106bfa1","Type":"ContainerStarted","Data":"ae384bb99dab07c624c4c535e548bc90367e23e736882453ea1f897e501ed911"} Jun 10 20:04:00.186235 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.186156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44ff4" event={"ID":"e11a4a4b-439b-4d27-892f-50dd2106bfa1","Type":"ContainerStarted","Data":"b22622b222fcc9241c714fd80d408d5d52c408eef05e3cc3b3438f37eda4f32e"} Jun 10 20:04:00.186235 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.186207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44ff4" event={"ID":"e11a4a4b-439b-4d27-892f-50dd2106bfa1","Type":"ContainerStarted","Data":"5200c1cf26b8ff1d891ce431614964e0dd21b8c770d6d76aa0660b866404b48a"} Jun 10 20:04:00.360681 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.360647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:00.360827 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.360707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:00.361265 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.361249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-service-ca-bundle\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:00.362992 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.362975 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ad4d49a-f4c2-4a5d-a033-4a74b563dd00-metrics-certs\") pod \"router-default-85bc74b479-6rjqc\" (UID: \"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00\") " pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:00.461658 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.461570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:04:00.461658 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.461622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:04:00.464401 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.464370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98a3a1d2-1842-453d-9cfb-b365a65a2468-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-zm2xf\" (UID: \"98a3a1d2-1842-453d-9cfb-b365a65a2468\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:04:00.464546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.464403 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e998891-ddc5-461c-b095-9f6d037029b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-m977k\" (UID: \"8e998891-ddc5-461c-b095-9f6d037029b9\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:04:00.579960 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.579931 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8x6rq\"" Jun 10 20:04:00.588769 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.588737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:00.615934 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.615901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:00.669077 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.669051 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mt6kq\"" Jun 10 20:04:00.670530 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.670486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:00.677174 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.677154 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" Jun 10 20:04:00.694298 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.684817 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lrssq\"" Jun 10 20:04:00.694298 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.693198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" Jun 10 20:04:00.747559 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.747492 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85bc74b479-6rjqc"] Jun 10 20:04:00.850579 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.850548 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k"] Jun 10 20:04:00.856119 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:00.856059 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e998891_ddc5_461c_b095_9f6d037029b9.slice/crio-9e8defbc22210a9a00ab48ef3e1c8f17a99ea870cc1055de801cd84396069aa6 WatchSource:0}: Error finding container 9e8defbc22210a9a00ab48ef3e1c8f17a99ea870cc1055de801cd84396069aa6: Status 404 returned error can't find the container with id 9e8defbc22210a9a00ab48ef3e1c8f17a99ea870cc1055de801cd84396069aa6 Jun 10 20:04:00.870319 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:00.870260 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf"] Jun 10 20:04:00.877006 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:00.876966 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a3a1d2_1842_453d_9cfb_b365a65a2468.slice/crio-bee9622aecfcca06deb159c5aa80211021db020d3c3a1dc75c133ea8525e9427 WatchSource:0}: Error finding container bee9622aecfcca06deb159c5aa80211021db020d3c3a1dc75c133ea8525e9427: Status 404 returned error can't find the container with id bee9622aecfcca06deb159c5aa80211021db020d3c3a1dc75c133ea8525e9427 Jun 10 20:04:01.194052 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:01.194013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" event={"ID":"98a3a1d2-1842-453d-9cfb-b365a65a2468","Type":"ContainerStarted","Data":"bee9622aecfcca06deb159c5aa80211021db020d3c3a1dc75c133ea8525e9427"} Jun 10 20:04:01.195641 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:01.195609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85bc74b479-6rjqc" event={"ID":"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00","Type":"ContainerStarted","Data":"706e41cc082630e58b218455d81d9d34d0c737f7deb68565f3d983b79869ca92"} Jun 10 20:04:01.195777 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:01.195661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85bc74b479-6rjqc" event={"ID":"6ad4d49a-f4c2-4a5d-a033-4a74b563dd00","Type":"ContainerStarted","Data":"ef02f9cff112523156597b87bb1ad25cf70186f167f9d34943c2e95bf62c28e9"} Jun 10 20:04:01.196700 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:01.196682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" event={"ID":"8e998891-ddc5-461c-b095-9f6d037029b9","Type":"ContainerStarted","Data":"9e8defbc22210a9a00ab48ef3e1c8f17a99ea870cc1055de801cd84396069aa6"} Jun 10 20:04:01.219176 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:01.219131 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85bc74b479-6rjqc" podStartSLOduration=33.219118102 podStartE2EDuration="33.219118102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:01.218017896 +0000 UTC m=+266.238648129" watchObservedRunningTime="2026-06-10 20:04:01.219118102 +0000 UTC m=+266.239748332" Jun 10 20:04:01.589913 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:01.589890 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:01.592432 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:01.592413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:02.204600 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:02.204552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44ff4" event={"ID":"e11a4a4b-439b-4d27-892f-50dd2106bfa1","Type":"ContainerStarted","Data":"6b8684097af2060e94406037c3242e8d66e5f1a107429a3214d28d1ac6078f30"} Jun 10 20:04:02.205051 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:02.204778 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:02.206390 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:02.206366 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85bc74b479-6rjqc" Jun 10 20:04:02.226586 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:02.222654 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-44ff4" podStartSLOduration=1.910047912 podStartE2EDuration="4.222635743s" totalImagesPullingTime="2.312587831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:03:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:02.222073611 +0000 UTC m=+267.242703842" watchObservedRunningTime="2026-06-10 20:04:02.222635743 +0000 UTC m=+267.243265977" Jun 10 20:04:03.210060 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.210022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" event={"ID":"98a3a1d2-1842-453d-9cfb-b365a65a2468","Type":"ContainerStarted","Data":"d2f95b45d8d51d4e35b74ae543b4490bdca2464c4fe0c2a29c92c4c31af75375"} Jun 10 20:04:03.227317 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.227259 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-zm2xf" podStartSLOduration=33.545000288 podStartE2EDuration="35.227244128s" totalImagesPullingTime="1.68224384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:03.226868156 +0000 UTC m=+268.247498391" watchObservedRunningTime="2026-06-10 20:04:03.227244128 +0000 UTC m=+268.247874400" Jun 10 20:04:03.331012 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.330971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:03.384082 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.384048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:03.435037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.435015 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:03.734239 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.734166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:03.830020 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.829991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:03.925422 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.925370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:03.928665 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.928637 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97"] Jun 10 20:04:03.931017 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.931001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" Jun 10 20:04:03.933601 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.933584 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-56d9k\"" Jun 10 20:04:03.934433 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.934413 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 20:04:03.942327 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.942306 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97"] Jun 10 20:04:03.995241 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.995138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/76a1e49f-7566-43bc-a75c-1a36a5757dee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m4c97\" (UID: \"76a1e49f-7566-43bc-a75c-1a36a5757dee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" Jun 10 20:04:03.997279 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:03.997256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:04.096252 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:04.096219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/76a1e49f-7566-43bc-a75c-1a36a5757dee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m4c97\" (UID: \"76a1e49f-7566-43bc-a75c-1a36a5757dee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" Jun 10 20:04:04.098684 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:04.098649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/76a1e49f-7566-43bc-a75c-1a36a5757dee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m4c97\" (UID: \"76a1e49f-7566-43bc-a75c-1a36a5757dee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" Jun 10 20:04:04.215194 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:04.215161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" event={"ID":"8e998891-ddc5-461c-b095-9f6d037029b9","Type":"ContainerStarted","Data":"91fda43fba6207a2d25fc4fc7bac9b6537430c6477477d2b504ed365dc1c7538"} Jun 10 20:04:04.231737 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:04.231695 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-m977k" podStartSLOduration=33.677983845 podStartE2EDuration="36.231681168s" totalImagesPullingTime="2.553697323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:04.230821057 +0000 UTC m=+269.251451289" watchObservedRunningTime="2026-06-10 20:04:04.231681168 +0000 UTC m=+269.252311399" Jun 10 20:04:04.239940 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:04.239922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" Jun 10 20:04:04.365860 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:04.365830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97"] Jun 10 20:04:04.368781 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:04.368751 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a1e49f_7566_43bc_a75c_1a36a5757dee.slice/crio-28506cb6d0977979baf1197e846908c2effe465878e4e3c5a9230568c7b3baa6 WatchSource:0}: Error finding container 28506cb6d0977979baf1197e846908c2effe465878e4e3c5a9230568c7b3baa6: Status 404 returned error can't find the container with id 28506cb6d0977979baf1197e846908c2effe465878e4e3c5a9230568c7b3baa6 Jun 10 20:04:05.220436 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:05.220400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" event={"ID":"76a1e49f-7566-43bc-a75c-1a36a5757dee","Type":"ContainerStarted","Data":"28506cb6d0977979baf1197e846908c2effe465878e4e3c5a9230568c7b3baa6"} Jun 10 20:04:06.225144 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:06.225104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" event={"ID":"76a1e49f-7566-43bc-a75c-1a36a5757dee","Type":"ContainerStarted","Data":"197512e6300596c2469b7cb5b5caaccabf3cb21832c140f327f6f499632982a3"} Jun 10 20:04:06.225636 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:06.225280 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" Jun 10 20:04:06.229780 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:06.229758 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" Jun 10 20:04:06.241853 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:06.241811 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m4c97" podStartSLOduration=2.190989983 podStartE2EDuration="3.241798771s" totalImagesPullingTime="1.050808788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:06.240596591 +0000 UTC m=+271.261226822" watchObservedRunningTime="2026-06-10 20:04:06.241798771 +0000 UTC m=+271.262429002" Jun 10 20:04:06.940578 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:06.940543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:07.010211 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:07.010180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:07.166387 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:07.166361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:08.416362 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:08.416332 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:08.475330 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:08.475301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:09.186718 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:09.186686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.099407 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.099370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.235882 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.235851 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.295372 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.295343 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57"] Jun 10 20:04:12.298728 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.298708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.301049 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.301029 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 20:04:12.301167 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.301126 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8z8lv\"" Jun 10 20:04:12.301737 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.301720 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 20:04:12.301824 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.301761 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 20:04:12.308408 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.308388 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57"] Jun 10 20:04:12.320421 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.320402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.356443 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.356369 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xlsns"] Jun 10 20:04:12.358693 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.358679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.361948 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.361921 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 20:04:12.361948 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.361948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 20:04:12.362085 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.362062 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r5p2r\"" Jun 10 20:04:12.362318 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.362306 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 20:04:12.371709 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.371674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.371820 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.371750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.371820 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.371790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtv4h\" (UniqueName: \"kubernetes.io/projected/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-kube-api-access-xtv4h\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.371922 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.371822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.405762 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.405727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.472887 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.472854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7rm\" (UniqueName: \"kubernetes.io/projected/f5eb363d-6da8-4112-a53b-d514f2d45f86-kube-api-access-8r7rm\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.472902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-tls\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.472940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv4h\" (UniqueName: \"kubernetes.io/projected/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-kube-api-access-xtv4h\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.473037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.472968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-root\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.472998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.473205 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-wtmp\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473205 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-accelerators-collector-config\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473205 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5eb363d-6da8-4112-a53b-d514f2d45f86-metrics-client-ca\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473205 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.473346 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473346 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.473346 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-sys\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473486 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-textfile\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.473899 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.473868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.475474 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.475454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.475645 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.475625 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.481204 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.481180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.481774 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.481750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtv4h\" (UniqueName: \"kubernetes.io/projected/9a9c4985-74d4-4160-bd41-9785c3bdc1a5-kube-api-access-xtv4h\") pod \"openshift-state-metrics-65f78d5c66-qfz57\" (UID: \"9a9c4985-74d4-4160-bd41-9785c3bdc1a5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.574450 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5eb363d-6da8-4112-a53b-d514f2d45f86-metrics-client-ca\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-sys\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-textfile\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7rm\" (UniqueName: \"kubernetes.io/projected/f5eb363d-6da8-4112-a53b-d514f2d45f86-kube-api-access-8r7rm\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-sys\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-tls\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-root\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574938 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:04:12.574718 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 20:04:12.574938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-wtmp\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574938 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:04:12.574788 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-tls podName:f5eb363d-6da8-4112-a53b-d514f2d45f86 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:13.074768425 +0000 UTC m=+278.095398656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-tls") pod "node-exporter-xlsns" (UID: "f5eb363d-6da8-4112-a53b-d514f2d45f86") : secret "node-exporter-tls" not found Jun 10 20:04:12.574938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-accelerators-collector-config\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-wtmp\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.574938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.574911 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5eb363d-6da8-4112-a53b-d514f2d45f86-root\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.575307 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.575035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5eb363d-6da8-4112-a53b-d514f2d45f86-metrics-client-ca\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.575307 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.575265 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-textfile\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.575405 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.575335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-accelerators-collector-config\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.577312 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.577293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.583895 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.583870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.585457 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.585437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7rm\" (UniqueName: \"kubernetes.io/projected/f5eb363d-6da8-4112-a53b-d514f2d45f86-kube-api-access-8r7rm\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:12.608122 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.608060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" Jun 10 20:04:12.683436 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.683403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.738069 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.738049 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57"] Jun 10 20:04:12.740036 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:12.740007 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9c4985_74d4_4160_bd41_9785c3bdc1a5.slice/crio-bcec74966dcafc015af984c8ca66df4ace7c900464de10c9b33f44b8c5395ea4 WatchSource:0}: Error finding container bcec74966dcafc015af984c8ca66df4ace7c900464de10c9b33f44b8c5395ea4: Status 404 returned error can't find the container with id bcec74966dcafc015af984c8ca66df4ace7c900464de10c9b33f44b8c5395ea4 Jun 10 20:04:12.783604 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.783550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:12.884150 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:12.884064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:13.080346 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.080307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-tls\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:13.082594 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.082567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5eb363d-6da8-4112-a53b-d514f2d45f86-node-exporter-tls\") pod \"node-exporter-xlsns\" (UID: \"f5eb363d-6da8-4112-a53b-d514f2d45f86\") " pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:13.213332 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.213254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:13.249140 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.249110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" event={"ID":"9a9c4985-74d4-4160-bd41-9785c3bdc1a5","Type":"ContainerStarted","Data":"fe4d2ecfa4465e6018c86eba73ddf401d49e89089b584daf01c3b7d4ae2b2f1d"} Jun 10 20:04:13.249269 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.249167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" event={"ID":"9a9c4985-74d4-4160-bd41-9785c3bdc1a5","Type":"ContainerStarted","Data":"11715c2d4cf083e71038dc0de028eebddee9f34efd7a3673286a5758a8d2d30e"} Jun 10 20:04:13.249269 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.249205 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" event={"ID":"9a9c4985-74d4-4160-bd41-9785c3bdc1a5","Type":"ContainerStarted","Data":"bcec74966dcafc015af984c8ca66df4ace7c900464de10c9b33f44b8c5395ea4"} Jun 10 20:04:13.267397 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.267370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xlsns" Jun 10 20:04:13.276568 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:13.276543 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5eb363d_6da8_4112_a53b_d514f2d45f86.slice/crio-fe89bbc17b63b5504ebe956b82cc77a867647541ad2b5738bbfa8ccb37d7bd1f WatchSource:0}: Error finding container fe89bbc17b63b5504ebe956b82cc77a867647541ad2b5738bbfa8ccb37d7bd1f: Status 404 returned error can't find the container with id fe89bbc17b63b5504ebe956b82cc77a867647541ad2b5738bbfa8ccb37d7bd1f Jun 10 20:04:13.313771 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.313740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:13.402650 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.402620 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:04:13.405133 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.405099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:13.405812 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.405792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.408551 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408345 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 20:04:13.408551 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408388 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 20:04:13.408551 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408434 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x2hzp\"" Jun 10 20:04:13.408750 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 20:04:13.408750 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408621 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 20:04:13.408750 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408668 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 20:04:13.408750 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 20:04:13.408750 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408735 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 20:04:13.408905 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408778 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 20:04:13.408905 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.408805 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 20:04:13.424547 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.424435 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:04:13.484102 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484102 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484102 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-config-out\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484102 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484435 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484435 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484435 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484435 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4r8j\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-kube-api-access-c4r8j\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-web-config\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-config-volume\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484771 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.484771 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.484699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.516828 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.516799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:13.585370 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.585370 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-config-volume\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.585607 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.585607 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.585607 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-config-out\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.585971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.586016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.586074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.586100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.586175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4r8j\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-kube-api-access-c4r8j\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.586226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-web-config\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.586338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.586960 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.586936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.587839 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.587764 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.588614 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.588549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.588982 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.588958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.589873 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.589851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.590066 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.590022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-web-config\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.590066 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.590029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.590204 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.590173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-config-out\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.590282 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.590264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-config-volume\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.590380 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.590360 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.591778 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.591755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.594076 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.594051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4r8j\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-kube-api-access-c4r8j\") pod \"alertmanager-main-0\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.717331 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.717295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:04:13.877678 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:13.877651 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:04:13.881706 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:13.881667 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e24186_d2cb_4608_9f41_e9b0fc925125.slice/crio-14be55e6a64bcaf9f32e24c34557f614b1bdcc49d5820d9ff534a3b06c86ae00 WatchSource:0}: Error finding container 14be55e6a64bcaf9f32e24c34557f614b1bdcc49d5820d9ff534a3b06c86ae00: Status 404 returned error can't find the container with id 14be55e6a64bcaf9f32e24c34557f614b1bdcc49d5820d9ff534a3b06c86ae00 Jun 10 20:04:14.254183 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:14.254140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlsns" event={"ID":"f5eb363d-6da8-4112-a53b-d514f2d45f86","Type":"ContainerStarted","Data":"fe89bbc17b63b5504ebe956b82cc77a867647541ad2b5738bbfa8ccb37d7bd1f"} Jun 10 20:04:14.255331 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:14.255307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerStarted","Data":"14be55e6a64bcaf9f32e24c34557f614b1bdcc49d5820d9ff534a3b06c86ae00"} Jun 10 20:04:15.260705 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.260627 2578 generic.go:356] "Generic (PLEG): container finished" podID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerID="c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643" exitCode=0 Jun 10 20:04:15.261109 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.260709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643"} Jun 10 20:04:15.263289 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.263266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" event={"ID":"9a9c4985-74d4-4160-bd41-9785c3bdc1a5","Type":"ContainerStarted","Data":"d6b0335690def8317b1ab732fe1c2aafca99285c45cf0f76500142c3548e5478"} Jun 10 20:04:15.265169 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.265145 2578 generic.go:356] "Generic (PLEG): container finished" podID="f5eb363d-6da8-4112-a53b-d514f2d45f86" containerID="4bd017d2fef265801a20c7fdd8e8f2cf9b9b7a7326ddf887b348516a41e29ba6" exitCode=0 Jun 10 20:04:15.265278 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.265193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlsns" event={"ID":"f5eb363d-6da8-4112-a53b-d514f2d45f86","Type":"ContainerDied","Data":"4bd017d2fef265801a20c7fdd8e8f2cf9b9b7a7326ddf887b348516a41e29ba6"} Jun 10 20:04:15.267970 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.267951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:15.301422 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.301378 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qfz57" podStartSLOduration=1.656959889 podStartE2EDuration="3.301362497s" totalImagesPullingTime="1.644402608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:15.300662653 +0000 UTC m=+280.321292889" watchObservedRunningTime="2026-06-10 20:04:15.301362497 +0000 UTC m=+280.321992722" Jun 10 20:04:15.344760 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.344741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:15.458714 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:15.458688 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:15.892783 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:04:15.892743 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" Jun 10 20:04:15.892783 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:04:15.892777 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zdprg" podUID="de2132a1-d324-4ec6-b2c3-95851da6e9f2" Jun 10 20:04:16.215627 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:16.215540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:16.273625 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:16.273598 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdprg" Jun 10 20:04:16.274079 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:16.273640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlsns" event={"ID":"f5eb363d-6da8-4112-a53b-d514f2d45f86","Type":"ContainerStarted","Data":"fbbd2ffbf0c963a33c7d276bebbb36a17efad60e3a55508b3e0f45284f65ac2d"} Jun 10 20:04:16.274079 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:16.273702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xlsns" event={"ID":"f5eb363d-6da8-4112-a53b-d514f2d45f86","Type":"ContainerStarted","Data":"df9dc800715d794460a6d6f9736d4f958f6d211067781a890c6a5f3547164f57"} Jun 10 20:04:16.274183 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:16.274102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:04:16.814430 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:16.814393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:16.864491 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:16.864466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:17.116988 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.116964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:17.214777 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.214747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:17.280375 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.280343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerStarted","Data":"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01"} Jun 10 20:04:17.280828 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.280417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerStarted","Data":"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1"} Jun 10 20:04:17.280828 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.280458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerStarted","Data":"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5"} Jun 10 20:04:17.280828 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.280497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerStarted","Data":"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88"} Jun 10 20:04:17.280828 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.280572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerStarted","Data":"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2"} Jun 10 20:04:17.315121 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:17.315076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:18.287574 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:18.287493 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerStarted","Data":"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb"} Jun 10 20:04:18.313825 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:18.313779 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xlsns" podStartSLOduration=5.051053861 podStartE2EDuration="6.313761289s" totalImagesPullingTime="1.190096551s" totalInitContainerRuntime="72.610877ms" isStatefulPod=true podCreationTimestamp="2026-06-10 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:16.294750988 +0000 UTC m=+281.315381223" watchObservedRunningTime="2026-06-10 20:04:18.313761289 +0000 UTC m=+283.334391523" Jun 10 20:04:18.314307 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:18.314275 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.859392275 podStartE2EDuration="5.314266428s" totalImagesPullingTime="3.440304058s" totalInitContainerRuntime="14.570095ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:18.312533688 +0000 UTC m=+283.333163916" watchObservedRunningTime="2026-06-10 20:04:18.314266428 +0000 UTC m=+283.334896658" Jun 10 20:04:18.530565 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:18.530537 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:19.740093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.740051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:04:19.742382 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.742350 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"image-registry-6f57d48f9b-kmzls\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:04:19.840990 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.840947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:04:19.843308 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.843287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/de2132a1-d324-4ec6-b2c3-95851da6e9f2-metrics-tls\") pod \"dns-default-zdprg\" (UID: \"de2132a1-d324-4ec6-b2c3-95851da6e9f2\") " pod="openshift-dns/dns-default-zdprg" Jun 10 20:04:19.878643 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.878614 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jb7fp\"" Jun 10 20:04:19.878777 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.878614 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxn4f\"" Jun 10 20:04:19.885086 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.885066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:04:19.885188 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:19.885174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdprg" Jun 10 20:04:20.026168 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:20.026144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zdprg"] Jun 10 20:04:20.028790 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:20.028765 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2132a1_d324_4ec6_b2c3_95851da6e9f2.slice/crio-7130d5e88815664c8162e0251fd37fb365fec276fdd2e9c9fb22d3b4cb3f62df WatchSource:0}: Error finding container 7130d5e88815664c8162e0251fd37fb365fec276fdd2e9c9fb22d3b4cb3f62df: Status 404 returned error can't find the container with id 7130d5e88815664c8162e0251fd37fb365fec276fdd2e9c9fb22d3b4cb3f62df Jun 10 20:04:20.048818 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:20.048798 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f57d48f9b-kmzls"] Jun 10 20:04:20.051083 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:20.051062 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823d184c_ddba_4a61_a541_9b409a41fbac.slice/crio-102e659aa29efc1f2c832c3c55c8925773ffad579a73987a40417ea9ca7dc04d WatchSource:0}: Error finding container 102e659aa29efc1f2c832c3c55c8925773ffad579a73987a40417ea9ca7dc04d: Status 404 returned error can't find the container with id 102e659aa29efc1f2c832c3c55c8925773ffad579a73987a40417ea9ca7dc04d Jun 10 20:04:20.297187 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:20.297096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" event={"ID":"823d184c-ddba-4a61-a541-9b409a41fbac","Type":"ContainerStarted","Data":"a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920"} Jun 10 20:04:20.297323 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:20.297191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" event={"ID":"823d184c-ddba-4a61-a541-9b409a41fbac","Type":"ContainerStarted","Data":"102e659aa29efc1f2c832c3c55c8925773ffad579a73987a40417ea9ca7dc04d"} Jun 10 20:04:20.297323 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:20.297220 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:04:20.298423 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:20.298390 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdprg" event={"ID":"de2132a1-d324-4ec6-b2c3-95851da6e9f2","Type":"ContainerStarted","Data":"7130d5e88815664c8162e0251fd37fb365fec276fdd2e9c9fb22d3b4cb3f62df"} Jun 10 20:04:20.316949 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:20.316897 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" podStartSLOduration=284.316880303 podStartE2EDuration="4m44.316880303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:20.31518621 +0000 UTC m=+285.335816440" watchObservedRunningTime="2026-06-10 20:04:20.316880303 +0000 UTC m=+285.337510533" Jun 10 20:04:22.017382 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:22.017351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:22.069686 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:22.069649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:23.312403 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:23.312373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdprg" event={"ID":"de2132a1-d324-4ec6-b2c3-95851da6e9f2","Type":"ContainerStarted","Data":"7c0f24a01dc1921b9a9815e8cc2cf6613427373e84be0761a846b748172209b7"} Jun 10 20:04:23.312896 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:23.312427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdprg" event={"ID":"de2132a1-d324-4ec6-b2c3-95851da6e9f2","Type":"ContainerStarted","Data":"ed4c2736ad1af279bc42fa5a9195a23de87ce94216855476bbaafa6340751b7b"} Jun 10 20:04:23.312896 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:23.312496 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zdprg" Jun 10 20:04:23.328779 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:23.328737 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zdprg" podStartSLOduration=251.941637677 podStartE2EDuration="4m14.32872185s" totalImagesPullingTime="2.387084173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:23.327826906 +0000 UTC m=+288.348457139" watchObservedRunningTime="2026-06-10 20:04:23.32872185 +0000 UTC m=+288.349352081" Jun 10 20:04:24.223665 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.223632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:24.266757 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.266727 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f7f544688-rcvb4"] Jun 10 20:04:24.269098 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.269084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.271846 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.271827 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 20:04:24.273135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.273116 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 20:04:24.273289 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.273122 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 20:04:24.273359 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.273284 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 20:04:24.273359 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.273173 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 20:04:24.273359 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.273172 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l9mnf\"" Jun 10 20:04:24.273497 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.273178 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 20:04:24.273497 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.273189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 20:04:24.282086 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.282064 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7f544688-rcvb4"] Jun 10 20:04:24.282397 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.282381 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 20:04:24.385355 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.385320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-oauth-config\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.385753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.385372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-serving-cert\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.385753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.385429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-trusted-ca-bundle\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.385753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.385461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-service-ca\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.385753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.385497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-oauth-serving-cert\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.385753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.385538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vgrp\" (UniqueName: \"kubernetes.io/projected/fd460410-9944-4a87-b31a-5d2bf3f05158-kube-api-access-2vgrp\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.385753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.385576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-console-config\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.486345 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.486253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-serving-cert\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.486345 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.486299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-trusted-ca-bundle\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.486345 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.486317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-service-ca\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.486656 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.486361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-oauth-serving-cert\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.486656 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.486379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vgrp\" (UniqueName: \"kubernetes.io/projected/fd460410-9944-4a87-b31a-5d2bf3f05158-kube-api-access-2vgrp\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.486656 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.486407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-console-config\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.486893 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.486864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-oauth-config\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.487244 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.487076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-service-ca\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.487244 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.487139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-oauth-serving-cert\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.487244 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.487196 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-console-config\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.487449 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.487293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-trusted-ca-bundle\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.488901 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.488875 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-serving-cert\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.489141 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.489119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-oauth-config\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.494392 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.494375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vgrp\" (UniqueName: \"kubernetes.io/projected/fd460410-9944-4a87-b31a-5d2bf3f05158-kube-api-access-2vgrp\") pod \"console-6f7f544688-rcvb4\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.583987 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.583953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:24.721804 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:24.721776 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7f544688-rcvb4"] Jun 10 20:04:24.724691 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:04:24.724666 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd460410_9944_4a87_b31a_5d2bf3f05158.slice/crio-f1c8824956d33108a9d27abb789d3e9d820d7c0be65bdac3b70db7fc56e5213a WatchSource:0}: Error finding container f1c8824956d33108a9d27abb789d3e9d820d7c0be65bdac3b70db7fc56e5213a: Status 404 returned error can't find the container with id f1c8824956d33108a9d27abb789d3e9d820d7c0be65bdac3b70db7fc56e5213a Jun 10 20:04:25.323370 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:25.323326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f544688-rcvb4" event={"ID":"fd460410-9944-4a87-b31a-5d2bf3f05158","Type":"ContainerStarted","Data":"f1c8824956d33108a9d27abb789d3e9d820d7c0be65bdac3b70db7fc56e5213a"} Jun 10 20:04:28.335484 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:28.335453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f544688-rcvb4" event={"ID":"fd460410-9944-4a87-b31a-5d2bf3f05158","Type":"ContainerStarted","Data":"50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24"} Jun 10 20:04:28.351635 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:28.351587 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f7f544688-rcvb4" podStartSLOduration=1.683630237 podStartE2EDuration="4.351571981s" totalImagesPullingTime="2.667941744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:28.350870945 +0000 UTC m=+293.371501176" watchObservedRunningTime="2026-06-10 20:04:28.351571981 +0000 UTC m=+293.372202193" Jun 10 20:04:30.420046 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:04:30.420002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mkwx6" podUID="4fecdbed-8e45-464d-88fd-5fd129de2e4a" Jun 10 20:04:32.121562 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:32.121498 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:32.188474 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:32.188445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:32.979973 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:32.979936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:33.037783 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:33.037753 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:33.320220 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:33.320142 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zdprg" Jun 10 20:04:34.584546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:34.584491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:34.584921 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:34.584567 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:34.586090 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:34.586063 2578 patch_prober.go:28] interesting pod/console-6f7f544688-rcvb4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 10 20:04:34.586200 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:34.586108 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f7f544688-rcvb4" podUID="fd460410-9944-4a87-b31a-5d2bf3f05158" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 10 20:04:35.366375 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:35.366343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:04:35.367006 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:35.366983 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:04:35.380173 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:35.380152 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 20:04:38.881459 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:38.881408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:39.889454 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:39.889422 2578 patch_prober.go:28] interesting pod/image-registry-6f57d48f9b-kmzls container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:04:39.889910 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:39.889477 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:04:39.943174 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:39.943146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:41.306398 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:41.306370 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:04:41.639969 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:41.639925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:41.698610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:41.698587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:42.443529 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:42.443485 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:42.543625 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:42.543598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:43.395270 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:43.395239 2578 generic.go:356] "Generic (PLEG): container finished" podID="3a573eda-5cdd-429d-b055-471a3b333114" containerID="1117dca198e8aa7d0a1df7027d41d506dd16324bc63e8f3b5d220fae302a1756" exitCode=0 Jun 10 20:04:43.395433 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:43.395311 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wgn6w" event={"ID":"3a573eda-5cdd-429d-b055-471a3b333114","Type":"ContainerDied","Data":"1117dca198e8aa7d0a1df7027d41d506dd16324bc63e8f3b5d220fae302a1756"} Jun 10 20:04:43.395680 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:43.395659 2578 scope.go:117] "RemoveContainer" containerID="1117dca198e8aa7d0a1df7027d41d506dd16324bc63e8f3b5d220fae302a1756" Jun 10 20:04:43.419205 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:43.419184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:04:44.401206 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:44.401174 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-wgn6w" event={"ID":"3a573eda-5cdd-429d-b055-471a3b333114","Type":"ContainerStarted","Data":"9ce715c329bc4e00f353781a2768f4a3aed81d778319bb2f659b4ea3a0d0f9ac"} Jun 10 20:04:44.589037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:44.589007 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:44.592582 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:44.592565 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:04:44.778490 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:44.778394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:44.873934 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:44.873882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:44.905663 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:44.905619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdprg_de2132a1-d324-4ec6-b2c3-95851da6e9f2/dns/0.log" Jun 10 20:04:44.937133 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:44.937100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:45.105621 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:45.105590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdprg_de2132a1-d324-4ec6-b2c3-95851da6e9f2/kube-rbac-proxy/0.log" Jun 10 20:04:45.387157 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:45.387083 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:45.487863 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:45.487831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:45.540411 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:45.540384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:45.705122 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:45.705048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w7q6n_94f990e9-05a4-48c2-aad9-d0075b23cab3/dns-node-resolver/0.log" Jun 10 20:04:45.905570 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:45.905540 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bc74b479-6rjqc_6ad4d49a-f4c2-4a5d-a033-4a74b563dd00/router/0.log" Jun 10 20:04:46.104760 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:46.104733 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-89lsn_f882e4ed-c9aa-440d-87a8-067231d28e9f/serve-healthcheck-canary/0.log" Jun 10 20:04:49.268546 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:49.268497 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f57d48f9b-kmzls"] Jun 10 20:04:49.342279 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:49.342235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:49.395379 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:49.395349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:49.484084 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:49.484039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:49.582258 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:49.582152 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:50.375023 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:50.374993 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:50.478051 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:50.477982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:51.475794 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:51.475750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:51.537174 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:51.537148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:53.370433 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:53.370399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:53.471850 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:53.471810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:55.449660 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:55.449597 2578 generic.go:356] "Generic (PLEG): container finished" podID="2968f6c9-e5c2-4074-b9b0-106fd382cc1b" containerID="65c21e0d63fb4927d280d52069ef0699fbf8fbb3beb9b9bf59defc171ddb8e05" exitCode=0 Jun 10 20:04:55.450043 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:55.449660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" event={"ID":"2968f6c9-e5c2-4074-b9b0-106fd382cc1b","Type":"ContainerDied","Data":"65c21e0d63fb4927d280d52069ef0699fbf8fbb3beb9b9bf59defc171ddb8e05"} Jun 10 20:04:55.450043 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:55.449996 2578 scope.go:117] "RemoveContainer" containerID="65c21e0d63fb4927d280d52069ef0699fbf8fbb3beb9b9bf59defc171ddb8e05" Jun 10 20:04:56.457590 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:56.456710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p85d5" event={"ID":"2968f6c9-e5c2-4074-b9b0-106fd382cc1b","Type":"ContainerStarted","Data":"2c25e80fb1109c3666846b60c48f311554a9dba7234c5b8cb77f70f4911cdb79"} Jun 10 20:04:59.452952 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:59.452921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:04:59.553846 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:04:59.553817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:04.493749 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:04.493715 2578 generic.go:356] "Generic (PLEG): container finished" podID="433db650-5114-4e11-997a-4c3e144c8dd8" containerID="34322ca235e0b538dbeed245dfce954bf39224c3e74b141472d47ce19f20c678" exitCode=0 Jun 10 20:05:04.494168 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:04.493787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" event={"ID":"433db650-5114-4e11-997a-4c3e144c8dd8","Type":"ContainerDied","Data":"34322ca235e0b538dbeed245dfce954bf39224c3e74b141472d47ce19f20c678"} Jun 10 20:05:04.494168 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:04.494141 2578 scope.go:117] "RemoveContainer" containerID="34322ca235e0b538dbeed245dfce954bf39224c3e74b141472d47ce19f20c678" Jun 10 20:05:05.498721 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:05.498687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-6c2zj" event={"ID":"433db650-5114-4e11-997a-4c3e144c8dd8","Type":"ContainerStarted","Data":"43f983e1e58196ec407d75887c72fc34b24bab979398062fa15bdcbea7fada67"} Jun 10 20:05:06.346156 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:06.346122 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:06.401400 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:06.401366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:08.373502 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:08.373469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:08.473960 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:08.473931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:14.288118 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:14.288058 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" containerName="registry" containerID="cri-o://a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920" gracePeriod=30 Jun 10 20:05:15.529234 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.529207 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:05:15.532741 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532722 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-trusted-ca\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.532839 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532753 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.532839 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532775 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wgqk\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-kube-api-access-7wgqk\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.532839 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532799 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-registry-certificates\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.532839 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532833 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-bound-sa-token\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.533082 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532881 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-image-registry-private-configuration\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.533082 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532934 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-installation-pull-secrets\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.533082 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.532973 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/823d184c-ddba-4a61-a541-9b409a41fbac-ca-trust-extracted\") pod \"823d184c-ddba-4a61-a541-9b409a41fbac\" (UID: \"823d184c-ddba-4a61-a541-9b409a41fbac\") " Jun 10 20:05:15.533233 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.533211 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:05:15.533292 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.533234 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:05:15.535464 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.535426 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:15.535649 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.535490 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:05:15.535720 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.535670 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:05:15.535785 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.535751 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-kube-api-access-7wgqk" (OuterVolumeSpecName: "kube-api-access-7wgqk") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "kube-api-access-7wgqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:05:15.535845 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.535781 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:15.541730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.541701 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/823d184c-ddba-4a61-a541-9b409a41fbac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "823d184c-ddba-4a61-a541-9b409a41fbac" (UID: "823d184c-ddba-4a61-a541-9b409a41fbac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:05:15.543498 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.543476 2578 generic.go:356] "Generic (PLEG): container finished" podID="823d184c-ddba-4a61-a541-9b409a41fbac" containerID="a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920" exitCode=0 Jun 10 20:05:15.543615 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.543541 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" Jun 10 20:05:15.543615 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.543549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" event={"ID":"823d184c-ddba-4a61-a541-9b409a41fbac","Type":"ContainerDied","Data":"a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920"} Jun 10 20:05:15.543725 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.543613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f57d48f9b-kmzls" event={"ID":"823d184c-ddba-4a61-a541-9b409a41fbac","Type":"ContainerDied","Data":"102e659aa29efc1f2c832c3c55c8925773ffad579a73987a40417ea9ca7dc04d"} Jun 10 20:05:15.543725 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.543641 2578 scope.go:117] "RemoveContainer" containerID="a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920" Jun 10 20:05:15.561891 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.561868 2578 scope.go:117] "RemoveContainer" containerID="a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920" Jun 10 20:05:15.562254 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:15.562233 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920\": container with ID starting with a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920 not found: ID does not exist" containerID="a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920" Jun 10 20:05:15.562310 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.562263 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920"} err="failed to get container status \"a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920\": rpc error: code = NotFound desc = could not find container \"a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920\": container with ID starting with a7580ea64e732ef6b9ccc47aca13495a5315849fbc460efce030582504aa5920 not found: ID does not exist" Jun 10 20:05:15.574426 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.574405 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f57d48f9b-kmzls"] Jun 10 20:05:15.578000 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.577978 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f57d48f9b-kmzls"] Jun 10 20:05:15.634161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634096 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-registry-certificates\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:15.634161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634120 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-bound-sa-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:15.634161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634129 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-image-registry-private-configuration\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:15.634161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634138 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/823d184c-ddba-4a61-a541-9b409a41fbac-installation-pull-secrets\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:15.634161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634146 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/823d184c-ddba-4a61-a541-9b409a41fbac-ca-trust-extracted\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:15.634161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634155 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823d184c-ddba-4a61-a541-9b409a41fbac-trusted-ca\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:15.634161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634163 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-registry-tls\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:15.634441 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:15.634171 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wgqk\" (UniqueName: \"kubernetes.io/projected/823d184c-ddba-4a61-a541-9b409a41fbac-kube-api-access-7wgqk\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:17.423913 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:17.423883 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" path="/var/lib/kubelet/pods/823d184c-ddba-4a61-a541-9b409a41fbac/volumes" Jun 10 20:05:23.369629 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:23.369590 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:23.421789 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:23.421757 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:27.355046 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:27.354948 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:27.405846 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:27.405820 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:28.420854 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:28.420816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:28.472638 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:28.472607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:32.682958 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:32.682927 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:05:32.683337 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:32.683205 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="alertmanager" containerID="cri-o://3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2" gracePeriod=120 Jun 10 20:05:32.683337 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:32.683269 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-web" containerID="cri-o://82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5" gracePeriod=120 Jun 10 20:05:32.683337 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:32.683283 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-metric" containerID="cri-o://4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01" gracePeriod=120 Jun 10 20:05:32.683337 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:32.683303 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy" containerID="cri-o://f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1" gracePeriod=120 Jun 10 20:05:32.683337 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:32.683320 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="config-reloader" containerID="cri-o://28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88" gracePeriod=120 Jun 10 20:05:32.683604 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:32.683336 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="prom-label-proxy" containerID="cri-o://58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb" gracePeriod=120 Jun 10 20:05:33.618222 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618190 2578 generic.go:356] "Generic (PLEG): container finished" podID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerID="58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb" exitCode=0 Jun 10 20:05:33.618222 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618217 2578 generic.go:356] "Generic (PLEG): container finished" podID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerID="f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1" exitCode=0 Jun 10 20:05:33.618222 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618226 2578 generic.go:356] "Generic (PLEG): container finished" podID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerID="28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88" exitCode=0 Jun 10 20:05:33.618222 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618233 2578 generic.go:356] "Generic (PLEG): container finished" podID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerID="3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2" exitCode=0 Jun 10 20:05:33.618492 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb"} Jun 10 20:05:33.618492 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1"} Jun 10 20:05:33.618492 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88"} Jun 10 20:05:33.618492 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.618386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2"} Jun 10 20:05:33.922606 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.922584 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:33.986462 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986431 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-main-tls\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.986462 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-metric\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.986715 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986484 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.986715 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986531 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-main-db\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.986715 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986700 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-web\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.986870 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986759 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-tls-assets\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.986870 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986803 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-config-out\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.986870 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986832 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:05:33.986870 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986841 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-web-config\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.987078 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986888 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-trusted-ca-bundle\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.987078 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986927 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-metrics-client-ca\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.987078 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986951 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-config-volume\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.987078 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.986975 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-cluster-tls-config\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.987078 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.987018 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4r8j\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-kube-api-access-c4r8j\") pod \"34e24186-d2cb-4608-9f41-e9b0fc925125\" (UID: \"34e24186-d2cb-4608-9f41-e9b0fc925125\") " Jun 10 20:05:33.987903 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.987483 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:05:33.987903 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.987649 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-main-db\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:33.987903 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.987673 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:33.988561 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.988506 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:05:33.989390 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.989362 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:05:33.989483 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.989385 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:33.989606 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.989542 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:33.989666 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.989638 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:33.989802 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.989785 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-config-volume" (OuterVolumeSpecName: "config-volume") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:33.990004 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.989977 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:33.991338 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.991318 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-kube-api-access-c4r8j" (OuterVolumeSpecName: "kube-api-access-c4r8j") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "kube-api-access-c4r8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:05:33.991912 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.991887 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-config-out" (OuterVolumeSpecName: "config-out") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:05:33.996282 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:33.996258 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:34.002097 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.002073 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-web-config" (OuterVolumeSpecName: "web-config") pod "34e24186-d2cb-4608-9f41-e9b0fc925125" (UID: "34e24186-d2cb-4608-9f41-e9b0fc925125"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:05:34.088223 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088195 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-tls-assets\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088223 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088221 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e24186-d2cb-4608-9f41-e9b0fc925125-config-out\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088223 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088230 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-web-config\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088223 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088239 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e24186-d2cb-4608-9f41-e9b0fc925125-metrics-client-ca\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088248 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-config-volume\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088256 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-cluster-tls-config\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088263 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4r8j\" (UniqueName: \"kubernetes.io/projected/34e24186-d2cb-4608-9f41-e9b0fc925125-kube-api-access-c4r8j\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088272 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-main-tls\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088281 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088291 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.088465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.088300 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e24186-d2cb-4608-9f41-e9b0fc925125-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:05:34.625848 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.625816 2578 generic.go:356] "Generic (PLEG): container finished" podID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerID="4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01" exitCode=0 Jun 10 20:05:34.625848 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.625842 2578 generic.go:356] "Generic (PLEG): container finished" podID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerID="82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5" exitCode=0 Jun 10 20:05:34.626046 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.625905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01"} Jun 10 20:05:34.626046 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.625979 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5"} Jun 10 20:05:34.626046 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.625919 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.626046 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.626019 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e24186-d2cb-4608-9f41-e9b0fc925125","Type":"ContainerDied","Data":"14be55e6a64bcaf9f32e24c34557f614b1bdcc49d5820d9ff534a3b06c86ae00"} Jun 10 20:05:34.626165 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.626069 2578 scope.go:117] "RemoveContainer" containerID="58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb" Jun 10 20:05:34.636158 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.636048 2578 scope.go:117] "RemoveContainer" containerID="4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01" Jun 10 20:05:34.643610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.643591 2578 scope.go:117] "RemoveContainer" containerID="f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1" Jun 10 20:05:34.650000 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.649981 2578 scope.go:117] "RemoveContainer" containerID="82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5" Jun 10 20:05:34.651825 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.651806 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:05:34.655921 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.655899 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:05:34.656749 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.656725 2578 scope.go:117] "RemoveContainer" containerID="28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88" Jun 10 20:05:34.663469 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.663451 2578 scope.go:117] "RemoveContainer" containerID="3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2" Jun 10 20:05:34.670177 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.670162 2578 scope.go:117] "RemoveContainer" containerID="c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643" Jun 10 20:05:34.676951 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.676887 2578 scope.go:117] "RemoveContainer" containerID="58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb" Jun 10 20:05:34.677230 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:34.677199 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb\": container with ID starting with 58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb not found: ID does not exist" containerID="58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb" Jun 10 20:05:34.677333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.677239 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb"} err="failed to get container status \"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb\": rpc error: code = NotFound desc = could not find container \"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb\": container with ID starting with 58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb not found: ID does not exist" Jun 10 20:05:34.677333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.677264 2578 scope.go:117] "RemoveContainer" containerID="4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01" Jun 10 20:05:34.677583 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:34.677566 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01\": container with ID starting with 4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01 not found: ID does not exist" containerID="4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01" Jun 10 20:05:34.677656 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.677587 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01"} err="failed to get container status \"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01\": rpc error: code = NotFound desc = could not find container \"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01\": container with ID starting with 4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01 not found: ID does not exist" Jun 10 20:05:34.677656 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.677607 2578 scope.go:117] "RemoveContainer" containerID="f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1" Jun 10 20:05:34.677994 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:34.677969 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1\": container with ID starting with f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1 not found: ID does not exist" containerID="f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1" Jun 10 20:05:34.678057 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678001 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1"} err="failed to get container status \"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1\": rpc error: code = NotFound desc = could not find container \"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1\": container with ID starting with f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1 not found: ID does not exist" Jun 10 20:05:34.678057 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678021 2578 scope.go:117] "RemoveContainer" containerID="82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5" Jun 10 20:05:34.678296 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:34.678280 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5\": container with ID starting with 82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5 not found: ID does not exist" containerID="82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5" Jun 10 20:05:34.678336 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678300 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5"} err="failed to get container status \"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5\": rpc error: code = NotFound desc = could not find container \"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5\": container with ID starting with 82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5 not found: ID does not exist" Jun 10 20:05:34.678336 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678315 2578 scope.go:117] "RemoveContainer" containerID="28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88" Jun 10 20:05:34.678564 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:34.678545 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88\": container with ID starting with 28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88 not found: ID does not exist" containerID="28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88" Jun 10 20:05:34.678636 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678567 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88"} err="failed to get container status \"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88\": rpc error: code = NotFound desc = could not find container \"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88\": container with ID starting with 28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88 not found: ID does not exist" Jun 10 20:05:34.678636 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678584 2578 scope.go:117] "RemoveContainer" containerID="3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2" Jun 10 20:05:34.678791 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:34.678775 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2\": container with ID starting with 3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2 not found: ID does not exist" containerID="3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2" Jun 10 20:05:34.678831 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678793 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2"} err="failed to get container status \"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2\": rpc error: code = NotFound desc = could not find container \"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2\": container with ID starting with 3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2 not found: ID does not exist" Jun 10 20:05:34.678831 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678805 2578 scope.go:117] "RemoveContainer" containerID="c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643" Jun 10 20:05:34.678923 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.678909 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:05:34.679025 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:05:34.679009 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643\": container with ID starting with c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643 not found: ID does not exist" containerID="c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643" Jun 10 20:05:34.679067 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679029 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643"} err="failed to get container status \"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643\": rpc error: code = NotFound desc = could not find container \"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643\": container with ID starting with c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643 not found: ID does not exist" Jun 10 20:05:34.679067 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679041 2578 scope.go:117] "RemoveContainer" containerID="58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb" Jun 10 20:05:34.679233 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679218 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="alertmanager" Jun 10 20:05:34.679271 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679238 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="alertmanager" Jun 10 20:05:34.679271 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679264 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-web" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679260 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb"} err="failed to get container status \"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb\": rpc error: code = NotFound desc = could not find container \"58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb\": container with ID starting with 58956797e476a92c79ee5fbb4afdc23fa699d59602c3987d25044bb613f1cabb not found: ID does not exist" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679273 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-web" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679280 2578 scope.go:117] "RemoveContainer" containerID="4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679284 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679293 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679304 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-metric" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679312 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-metric" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679322 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="init-config-reloader" Jun 10 20:05:34.679333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679329 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="init-config-reloader" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679338 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="config-reloader" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679347 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="config-reloader" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679354 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="prom-label-proxy" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679359 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="prom-label-proxy" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679373 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" containerName="registry" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679378 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" containerName="registry" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679434 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="823d184c-ddba-4a61-a541-9b409a41fbac" containerName="registry" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679447 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-web" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679453 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="config-reloader" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679459 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="prom-label-proxy" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679465 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679471 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="kube-rbac-proxy-metric" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679477 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" containerName="alertmanager" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679503 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01"} err="failed to get container status \"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01\": rpc error: code = NotFound desc = could not find container \"4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01\": container with ID starting with 4b85c8fbc371c5a8d31172e665adf9c675adde46c0108d4ad84cbf7925124e01 not found: ID does not exist" Jun 10 20:05:34.679732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679536 2578 scope.go:117] "RemoveContainer" containerID="f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1" Jun 10 20:05:34.680264 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679736 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1"} err="failed to get container status \"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1\": rpc error: code = NotFound desc = could not find container \"f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1\": container with ID starting with f3e4b1068e223e831eb2f08f6abb9007281c2197e7064b94d2ffaf64e06195d1 not found: ID does not exist" Jun 10 20:05:34.680264 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679751 2578 scope.go:117] "RemoveContainer" containerID="82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5" Jun 10 20:05:34.680264 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679957 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5"} err="failed to get container status \"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5\": rpc error: code = NotFound desc = could not find container \"82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5\": container with ID starting with 82fe6fdbe138f7aacd0cb9c5efdf1d97b193634f85f30f4b4e7e52d98059d0e5 not found: ID does not exist" Jun 10 20:05:34.680264 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.679978 2578 scope.go:117] "RemoveContainer" containerID="28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88" Jun 10 20:05:34.680264 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.680182 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88"} err="failed to get container status \"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88\": rpc error: code = NotFound desc = could not find container \"28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88\": container with ID starting with 28cd220e715d66245cadc9ebe3c924f88af301f010725702aa01045dd9c91a88 not found: ID does not exist" Jun 10 20:05:34.680264 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.680196 2578 scope.go:117] "RemoveContainer" containerID="3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2" Jun 10 20:05:34.680496 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.680419 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2"} err="failed to get container status \"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2\": rpc error: code = NotFound desc = could not find container \"3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2\": container with ID starting with 3bf12beb3b6c59432c47c5d858473b980191cdff9918de52c079678f21c18ca2 not found: ID does not exist" Jun 10 20:05:34.680496 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.680432 2578 scope.go:117] "RemoveContainer" containerID="c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643" Jun 10 20:05:34.680657 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.680639 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643"} err="failed to get container status \"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643\": rpc error: code = NotFound desc = could not find container \"c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643\": container with ID starting with c5821cd93c586df6824941d9b791831629da301bd721a5ef0b3db898c31f8643 not found: ID does not exist" Jun 10 20:05:34.684852 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.684836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.687470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 20:05:34.687470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 20:05:34.687470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687435 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 20:05:34.687470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x2hzp\"" Jun 10 20:05:34.687470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687467 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 20:05:34.687822 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687440 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 20:05:34.687822 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 20:05:34.687822 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687379 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 20:05:34.687822 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.687416 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 20:05:34.692123 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.692106 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 20:05:34.696089 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.696068 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:05:34.792938 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.792912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/16596015-12cd-4cf4-91a4-57d2410634a6-config-out\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.792942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.792960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.792982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.792998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/16596015-12cd-4cf4-91a4-57d2410634a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16596015-12cd-4cf4-91a4-57d2410634a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16596015-12cd-4cf4-91a4-57d2410634a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zwpp\" (UniqueName: \"kubernetes.io/projected/16596015-12cd-4cf4-91a4-57d2410634a6-kube-api-access-7zwpp\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-web-config\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.793340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.793291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/16596015-12cd-4cf4-91a4-57d2410634a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.893868 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.893780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16596015-12cd-4cf4-91a4-57d2410634a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.893868 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.893817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.893868 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.893841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zwpp\" (UniqueName: \"kubernetes.io/projected/16596015-12cd-4cf4-91a4-57d2410634a6-kube-api-access-7zwpp\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.893870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.893904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-web-config\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.893933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.893977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/16596015-12cd-4cf4-91a4-57d2410634a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/16596015-12cd-4cf4-91a4-57d2410634a6-config-out\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894507 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/16596015-12cd-4cf4-91a4-57d2410634a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894507 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16596015-12cd-4cf4-91a4-57d2410634a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894833 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16596015-12cd-4cf4-91a4-57d2410634a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.894915 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.894881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16596015-12cd-4cf4-91a4-57d2410634a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.895080 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.895061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/16596015-12cd-4cf4-91a4-57d2410634a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.896990 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.896958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-web-config\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.897103 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.896990 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.897103 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.897056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.897103 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.897099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.897442 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.897420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.897542 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.897465 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/16596015-12cd-4cf4-91a4-57d2410634a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.897928 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.897908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.898296 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.898278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/16596015-12cd-4cf4-91a4-57d2410634a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.898703 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.898690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/16596015-12cd-4cf4-91a4-57d2410634a6-config-out\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.901610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.901594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zwpp\" (UniqueName: \"kubernetes.io/projected/16596015-12cd-4cf4-91a4-57d2410634a6-kube-api-access-7zwpp\") pod \"alertmanager-main-0\" (UID: \"16596015-12cd-4cf4-91a4-57d2410634a6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:34.993666 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:34.993635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:05:35.129061 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.129028 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:05:35.132293 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:05:35.132268 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16596015_12cd_4cf4_91a4_57d2410634a6.slice/crio-3d1d6af27ef9f3bbfb5cab207e0f721c96c21d9c944d8ddbfcad5c5b5542626d WatchSource:0}: Error finding container 3d1d6af27ef9f3bbfb5cab207e0f721c96c21d9c944d8ddbfcad5c5b5542626d: Status 404 returned error can't find the container with id 3d1d6af27ef9f3bbfb5cab207e0f721c96c21d9c944d8ddbfcad5c5b5542626d Jun 10 20:05:35.290210 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.290175 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-586f458b5-bjqfp"] Jun 10 20:05:35.294143 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.294117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.303818 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.303796 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-586f458b5-bjqfp"] Jun 10 20:05:35.343681 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.343655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:35.398236 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.398210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-oauth-serving-cert\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.398352 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.398240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-trusted-ca-bundle\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.398352 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.398258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxjfv\" (UniqueName: \"kubernetes.io/projected/ecb0290f-9b66-4457-a654-9aa347ab7d67-kube-api-access-cxjfv\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.398352 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.398288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-config\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.398538 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.398384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-service-ca\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.398538 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.398445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-oauth-config\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.398538 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.398493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-serving-cert\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.423288 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.423231 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34e24186-d2cb-4608-9f41-e9b0fc925125" path="/var/lib/kubelet/pods/34e24186-d2cb-4608-9f41-e9b0fc925125/volumes" Jun 10 20:05:35.498901 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.498869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-serving-cert\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.499071 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.498909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-oauth-serving-cert\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.499071 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.498926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-trusted-ca-bundle\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.499071 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.498942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxjfv\" (UniqueName: \"kubernetes.io/projected/ecb0290f-9b66-4457-a654-9aa347ab7d67-kube-api-access-cxjfv\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.499959 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.499932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-oauth-serving-cert\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.500130 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.500102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-trusted-ca-bundle\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.500231 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.499714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-config\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.500372 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.500359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-service-ca\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.500507 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.500493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-oauth-config\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.505712 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.500279 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-config\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.505712 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.502242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-service-ca\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.506561 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.506497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-oauth-config\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.506561 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.506556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-serving-cert\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.508204 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.508183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxjfv\" (UniqueName: \"kubernetes.io/projected/ecb0290f-9b66-4457-a654-9aa347ab7d67-kube-api-access-cxjfv\") pod \"console-586f458b5-bjqfp\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.605257 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.605231 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:35.631627 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.631596 2578 generic.go:356] "Generic (PLEG): container finished" podID="16596015-12cd-4cf4-91a4-57d2410634a6" containerID="9e37b57569ecb8aeb13c003b40229092e259f382f0a5140587100c45f4ef3d49" exitCode=0 Jun 10 20:05:35.631764 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.631675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerDied","Data":"9e37b57569ecb8aeb13c003b40229092e259f382f0a5140587100c45f4ef3d49"} Jun 10 20:05:35.631806 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.631792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerStarted","Data":"3d1d6af27ef9f3bbfb5cab207e0f721c96c21d9c944d8ddbfcad5c5b5542626d"} Jun 10 20:05:35.739554 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:35.739500 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-586f458b5-bjqfp"] Jun 10 20:05:35.748611 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:05:35.748578 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb0290f_9b66_4457_a654_9aa347ab7d67.slice/crio-48448f9834cf586e12324190e237d76400d95f7c8f62952def57cf7b5ad14740 WatchSource:0}: Error finding container 48448f9834cf586e12324190e237d76400d95f7c8f62952def57cf7b5ad14740: Status 404 returned error can't find the container with id 48448f9834cf586e12324190e237d76400d95f7c8f62952def57cf7b5ad14740 Jun 10 20:05:36.050602 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.050580 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:36.150883 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.150851 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:36.638561 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.638524 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerStarted","Data":"66993c855dc05fb4191677b8a5fc656964e927da47cb68522e5a6b1d33e16fb6"} Jun 10 20:05:36.638754 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.638609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerStarted","Data":"9241f7a3cfdafb4d16067f1e2848abf32075136235cad9848739d5e5772be60d"} Jun 10 20:05:36.638754 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.638650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerStarted","Data":"5f6369e59aaa693e1f35138ae84288192b815b9c1f20eb09172927ffa4280479"} Jun 10 20:05:36.638754 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.638684 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerStarted","Data":"c7d18b32ff7e88622c79ef5b54581107845e128f03509123cabdc0c679099be1"} Jun 10 20:05:36.638754 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.638719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerStarted","Data":"1e5aa977521d0085b89de26aacde5401b59911515c4e15e1f0dd37a5924f02dd"} Jun 10 20:05:36.638754 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.638753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"16596015-12cd-4cf4-91a4-57d2410634a6","Type":"ContainerStarted","Data":"dd356d0fb893dbdaa818c1c0c69a516d7dd7c292931d9ac3f357d12eeaaf4d53"} Jun 10 20:05:36.640074 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.640048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-586f458b5-bjqfp" event={"ID":"ecb0290f-9b66-4457-a654-9aa347ab7d67","Type":"ContainerStarted","Data":"11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386"} Jun 10 20:05:36.640188 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.640086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-586f458b5-bjqfp" event={"ID":"ecb0290f-9b66-4457-a654-9aa347ab7d67","Type":"ContainerStarted","Data":"48448f9834cf586e12324190e237d76400d95f7c8f62952def57cf7b5ad14740"} Jun 10 20:05:36.664667 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.664628 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.645513272 podStartE2EDuration="2.664615293s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.102021ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:05:36.663463683 +0000 UTC m=+361.684093913" watchObservedRunningTime="2026-06-10 20:05:36.664615293 +0000 UTC m=+361.685245524" Jun 10 20:05:36.684102 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:36.684047 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-586f458b5-bjqfp" podStartSLOduration=1.684030265 podStartE2EDuration="1.684030265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:05:36.683774939 +0000 UTC m=+361.704405171" watchObservedRunningTime="2026-06-10 20:05:36.684030265 +0000 UTC m=+361.704660496" Jun 10 20:05:45.606165 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.606133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:45.606575 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.606182 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:45.611045 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.611026 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:45.682585 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.682557 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:05:45.727378 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.727348 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7f544688-rcvb4"] Jun 10 20:05:45.836149 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.836090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:45.884034 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.883960 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:45.936321 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.936290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:45.986222 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:45.986192 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:49.314295 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:49.314247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:05:49.316538 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:49.316498 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fecdbed-8e45-464d-88fd-5fd129de2e4a-metrics-certs\") pod \"network-metrics-daemon-mkwx6\" (UID: \"4fecdbed-8e45-464d-88fd-5fd129de2e4a\") " pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:05:49.422180 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:49.422149 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5ggwg\"" Jun 10 20:05:49.430146 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:49.430120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mkwx6" Jun 10 20:05:49.559358 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:49.559327 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mkwx6"] Jun 10 20:05:49.562168 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:05:49.562140 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fecdbed_8e45_464d_88fd_5fd129de2e4a.slice/crio-c3c94876df07d805b38abfb4d7035ffdfeea15d2bf4abad9ed1623ce4afe6d46 WatchSource:0}: Error finding container c3c94876df07d805b38abfb4d7035ffdfeea15d2bf4abad9ed1623ce4afe6d46: Status 404 returned error can't find the container with id c3c94876df07d805b38abfb4d7035ffdfeea15d2bf4abad9ed1623ce4afe6d46 Jun 10 20:05:49.564078 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:49.564063 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:05:49.697126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:49.697094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkwx6" event={"ID":"4fecdbed-8e45-464d-88fd-5fd129de2e4a","Type":"ContainerStarted","Data":"c3c94876df07d805b38abfb4d7035ffdfeea15d2bf4abad9ed1623ce4afe6d46"} Jun 10 20:05:50.703917 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:50.703824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkwx6" event={"ID":"4fecdbed-8e45-464d-88fd-5fd129de2e4a","Type":"ContainerStarted","Data":"04eadf68d9401835d43b5427c748d28082d7c828753dc3d5148e25db787e5547"} Jun 10 20:05:50.703917 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:50.703879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mkwx6" event={"ID":"4fecdbed-8e45-464d-88fd-5fd129de2e4a","Type":"ContainerStarted","Data":"a6ae663c293a8fd4f784b122024da06e8356605f1225b74688439ed1f5485aff"} Jun 10 20:05:50.720328 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:50.720275 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mkwx6" podStartSLOduration=374.917233325 podStartE2EDuration="6m15.720260739s" totalImagesPullingTime="803.027414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:05:50.719092621 +0000 UTC m=+375.739722854" watchObservedRunningTime="2026-06-10 20:05:50.720260739 +0000 UTC m=+375.740890969" Jun 10 20:05:50.803815 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:50.803774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:50.905470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:50.905439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:52.296364 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:52.296325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:52.351523 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:52.351490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:53.370884 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:53.370851 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:05:53.471119 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:05:53.471088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:10.751038 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:10.750979 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f7f544688-rcvb4" podUID="fd460410-9944-4a87-b31a-5d2bf3f05158" containerName="console" containerID="cri-o://50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24" gracePeriod=15 Jun 10 20:06:10.999649 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:10.999623 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:06:11.095668 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.095639 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-serving-cert\") pod \"fd460410-9944-4a87-b31a-5d2bf3f05158\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " Jun 10 20:06:11.095821 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.095685 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-oauth-config\") pod \"fd460410-9944-4a87-b31a-5d2bf3f05158\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " Jun 10 20:06:11.095821 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.095702 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-service-ca\") pod \"fd460410-9944-4a87-b31a-5d2bf3f05158\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " Jun 10 20:06:11.095821 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.095745 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-oauth-serving-cert\") pod \"fd460410-9944-4a87-b31a-5d2bf3f05158\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " Jun 10 20:06:11.095821 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.095777 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-console-config\") pod \"fd460410-9944-4a87-b31a-5d2bf3f05158\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " Jun 10 20:06:11.095821 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.095818 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vgrp\" (UniqueName: \"kubernetes.io/projected/fd460410-9944-4a87-b31a-5d2bf3f05158-kube-api-access-2vgrp\") pod \"fd460410-9944-4a87-b31a-5d2bf3f05158\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " Jun 10 20:06:11.096027 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.095849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-trusted-ca-bundle\") pod \"fd460410-9944-4a87-b31a-5d2bf3f05158\" (UID: \"fd460410-9944-4a87-b31a-5d2bf3f05158\") " Jun 10 20:06:11.096169 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.096142 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd460410-9944-4a87-b31a-5d2bf3f05158" (UID: "fd460410-9944-4a87-b31a-5d2bf3f05158"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:06:11.096243 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.096199 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-console-config" (OuterVolumeSpecName: "console-config") pod "fd460410-9944-4a87-b31a-5d2bf3f05158" (UID: "fd460410-9944-4a87-b31a-5d2bf3f05158"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:06:11.096243 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.096151 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd460410-9944-4a87-b31a-5d2bf3f05158" (UID: "fd460410-9944-4a87-b31a-5d2bf3f05158"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:06:11.096341 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.096323 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd460410-9944-4a87-b31a-5d2bf3f05158" (UID: "fd460410-9944-4a87-b31a-5d2bf3f05158"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:06:11.098108 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.098083 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd460410-9944-4a87-b31a-5d2bf3f05158" (UID: "fd460410-9944-4a87-b31a-5d2bf3f05158"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:06:11.098304 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.098282 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd460410-9944-4a87-b31a-5d2bf3f05158" (UID: "fd460410-9944-4a87-b31a-5d2bf3f05158"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:06:11.098353 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.098282 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd460410-9944-4a87-b31a-5d2bf3f05158-kube-api-access-2vgrp" (OuterVolumeSpecName: "kube-api-access-2vgrp") pod "fd460410-9944-4a87-b31a-5d2bf3f05158" (UID: "fd460410-9944-4a87-b31a-5d2bf3f05158"). InnerVolumeSpecName "kube-api-access-2vgrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:06:11.196967 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.196933 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-console-config\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:06:11.196967 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.196964 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vgrp\" (UniqueName: \"kubernetes.io/projected/fd460410-9944-4a87-b31a-5d2bf3f05158-kube-api-access-2vgrp\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:06:11.196967 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.196974 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-trusted-ca-bundle\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:06:11.197199 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.196983 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-serving-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:06:11.197199 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.196992 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd460410-9944-4a87-b31a-5d2bf3f05158-console-oauth-config\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:06:11.197199 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.197000 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-service-ca\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:06:11.197199 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.197008 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd460410-9944-4a87-b31a-5d2bf3f05158-oauth-serving-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:06:11.786059 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.785964 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd460410-9944-4a87-b31a-5d2bf3f05158" containerID="50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24" exitCode=0 Jun 10 20:06:11.786059 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.786012 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f544688-rcvb4" Jun 10 20:06:11.786059 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.786028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f544688-rcvb4" event={"ID":"fd460410-9944-4a87-b31a-5d2bf3f05158","Type":"ContainerDied","Data":"50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24"} Jun 10 20:06:11.786610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.786070 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f544688-rcvb4" event={"ID":"fd460410-9944-4a87-b31a-5d2bf3f05158","Type":"ContainerDied","Data":"f1c8824956d33108a9d27abb789d3e9d820d7c0be65bdac3b70db7fc56e5213a"} Jun 10 20:06:11.786610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.786091 2578 scope.go:117] "RemoveContainer" containerID="50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24" Jun 10 20:06:11.794327 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.794300 2578 scope.go:117] "RemoveContainer" containerID="50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24" Jun 10 20:06:11.794638 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:06:11.794615 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24\": container with ID starting with 50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24 not found: ID does not exist" containerID="50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24" Jun 10 20:06:11.794724 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.794643 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24"} err="failed to get container status \"50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24\": rpc error: code = NotFound desc = could not find container \"50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24\": container with ID starting with 50c169bc15d2fe77bf2d0dc1c57e61f785818a7a423e931dbf892fba306dfb24 not found: ID does not exist" Jun 10 20:06:11.801729 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.801707 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7f544688-rcvb4"] Jun 10 20:06:11.807563 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:11.807540 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f7f544688-rcvb4"] Jun 10 20:06:13.423642 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:13.423615 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd460410-9944-4a87-b31a-5d2bf3f05158" path="/var/lib/kubelet/pods/fd460410-9944-4a87-b31a-5d2bf3f05158/volumes" Jun 10 20:06:14.160640 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:14.160607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:14.217143 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:14.217097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:25.396963 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:25.396928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:25.501659 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:25.501628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:35.401911 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:35.401885 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:35.455552 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:35.455527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:51.934239 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:51.934208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:52.747500 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:52.747470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:55.539292 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:55.539188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:55.640211 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:55.640178 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:56.721243 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:56.721203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:56.830210 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:56.830181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:56.943423 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:56.943394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:06:59.344699 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.344666 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-82tst"] Jun 10 20:06:59.345064 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.344964 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd460410-9944-4a87-b31a-5d2bf3f05158" containerName="console" Jun 10 20:06:59.345064 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.344976 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd460410-9944-4a87-b31a-5d2bf3f05158" containerName="console" Jun 10 20:06:59.345064 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.345039 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd460410-9944-4a87-b31a-5d2bf3f05158" containerName="console" Jun 10 20:06:59.347989 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.347973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.350418 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.350388 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 20:06:59.350623 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.350428 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 20:06:59.351333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.351320 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r6d8t\"" Jun 10 20:06:59.357536 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.357488 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-82tst"] Jun 10 20:06:59.497774 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.497729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f83238f-4b2c-40cd-8fca-5270913430c7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-82tst\" (UID: \"6f83238f-4b2c-40cd-8fca-5270913430c7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.497977 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.497805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6r5w\" (UniqueName: \"kubernetes.io/projected/6f83238f-4b2c-40cd-8fca-5270913430c7-kube-api-access-h6r5w\") pod \"cert-manager-webhook-7dc76cbb94-82tst\" (UID: \"6f83238f-4b2c-40cd-8fca-5270913430c7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.598932 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.598830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6r5w\" (UniqueName: \"kubernetes.io/projected/6f83238f-4b2c-40cd-8fca-5270913430c7-kube-api-access-h6r5w\") pod \"cert-manager-webhook-7dc76cbb94-82tst\" (UID: \"6f83238f-4b2c-40cd-8fca-5270913430c7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.598932 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.598917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f83238f-4b2c-40cd-8fca-5270913430c7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-82tst\" (UID: \"6f83238f-4b2c-40cd-8fca-5270913430c7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.607573 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.607540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f83238f-4b2c-40cd-8fca-5270913430c7-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-82tst\" (UID: \"6f83238f-4b2c-40cd-8fca-5270913430c7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.607573 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.607563 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6r5w\" (UniqueName: \"kubernetes.io/projected/6f83238f-4b2c-40cd-8fca-5270913430c7-kube-api-access-h6r5w\") pod \"cert-manager-webhook-7dc76cbb94-82tst\" (UID: \"6f83238f-4b2c-40cd-8fca-5270913430c7\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.674775 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.674747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:06:59.802431 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.802401 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-82tst"] Jun 10 20:06:59.805894 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:06:59.805865 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f83238f_4b2c_40cd_8fca_5270913430c7.slice/crio-caab2f31184a48441d4ebc2c5108d0e92e851860cac3221e22ffa7a3a3ca42a2 WatchSource:0}: Error finding container caab2f31184a48441d4ebc2c5108d0e92e851860cac3221e22ffa7a3a3ca42a2: Status 404 returned error can't find the container with id caab2f31184a48441d4ebc2c5108d0e92e851860cac3221e22ffa7a3a3ca42a2 Jun 10 20:06:59.979967 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:06:59.979886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" event={"ID":"6f83238f-4b2c-40cd-8fca-5270913430c7","Type":"ContainerStarted","Data":"caab2f31184a48441d4ebc2c5108d0e92e851860cac3221e22ffa7a3a3ca42a2"} Jun 10 20:07:00.038129 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:00.038103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:00.623257 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:00.623226 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:02.125639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.125612 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:02.159676 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.159643 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj"] Jun 10 20:07:02.163174 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.163151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:02.165569 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.165502 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-92qhq\"" Jun 10 20:07:02.173252 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.173223 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj"] Jun 10 20:07:02.223569 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.223538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:02.323775 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.323745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ghk5\" (UniqueName: \"kubernetes.io/projected/a8511176-fa09-4bc4-94b0-7c31bc7fce43-kube-api-access-9ghk5\") pod \"cert-manager-cainjector-5d99449ffd-j9fhj\" (UID: \"a8511176-fa09-4bc4-94b0-7c31bc7fce43\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:02.323934 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.323818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8511176-fa09-4bc4-94b0-7c31bc7fce43-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-j9fhj\" (UID: \"a8511176-fa09-4bc4-94b0-7c31bc7fce43\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:02.424659 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.424570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8511176-fa09-4bc4-94b0-7c31bc7fce43-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-j9fhj\" (UID: \"a8511176-fa09-4bc4-94b0-7c31bc7fce43\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:02.424659 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.424635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ghk5\" (UniqueName: \"kubernetes.io/projected/a8511176-fa09-4bc4-94b0-7c31bc7fce43-kube-api-access-9ghk5\") pod \"cert-manager-cainjector-5d99449ffd-j9fhj\" (UID: \"a8511176-fa09-4bc4-94b0-7c31bc7fce43\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:02.441588 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.441557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8511176-fa09-4bc4-94b0-7c31bc7fce43-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-j9fhj\" (UID: \"a8511176-fa09-4bc4-94b0-7c31bc7fce43\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:02.441751 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.441649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ghk5\" (UniqueName: \"kubernetes.io/projected/a8511176-fa09-4bc4-94b0-7c31bc7fce43-kube-api-access-9ghk5\") pod \"cert-manager-cainjector-5d99449ffd-j9fhj\" (UID: \"a8511176-fa09-4bc4-94b0-7c31bc7fce43\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:02.475342 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:02.475310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" Jun 10 20:07:03.262306 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:03.262212 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj"] Jun 10 20:07:03.264763 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:07:03.264736 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8511176_fa09_4bc4_94b0_7c31bc7fce43.slice/crio-8650efdd8aebf44fdc8db50de127c872bce1c70988d27d99bc083b6f6d453598 WatchSource:0}: Error finding container 8650efdd8aebf44fdc8db50de127c872bce1c70988d27d99bc083b6f6d453598: Status 404 returned error can't find the container with id 8650efdd8aebf44fdc8db50de127c872bce1c70988d27d99bc083b6f6d453598 Jun 10 20:07:04.002583 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.002539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" event={"ID":"a8511176-fa09-4bc4-94b0-7c31bc7fce43","Type":"ContainerStarted","Data":"592c6a5d92e995d33e72d3f9344b26af31d6b154d0e7c0cd122804bf35cd161e"} Jun 10 20:07:04.002583 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.002587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" event={"ID":"a8511176-fa09-4bc4-94b0-7c31bc7fce43","Type":"ContainerStarted","Data":"8650efdd8aebf44fdc8db50de127c872bce1c70988d27d99bc083b6f6d453598"} Jun 10 20:07:04.003954 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.003931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" event={"ID":"6f83238f-4b2c-40cd-8fca-5270913430c7","Type":"ContainerStarted","Data":"e0394bc823a3b8f8abc2c9c3b1e29d7d77f39a61516bfb558ce083c34f0d5165"} Jun 10 20:07:04.004075 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.004046 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:07:04.018020 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.017979 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j9fhj" podStartSLOduration=2.017967147 podStartE2EDuration="2.017967147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:04.017671432 +0000 UTC m=+449.038301664" watchObservedRunningTime="2026-06-10 20:07:04.017967147 +0000 UTC m=+449.038597378" Jun 10 20:07:04.032969 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.032927 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" podStartSLOduration=1.626767227 podStartE2EDuration="5.032914466s" totalImagesPullingTime="3.406147239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:04.031482504 +0000 UTC m=+449.052112735" watchObservedRunningTime="2026-06-10 20:07:04.032914466 +0000 UTC m=+449.053544696" Jun 10 20:07:04.568925 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.568894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:04.624344 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:04.624313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:08.413487 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:08.413458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:10.011019 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:10.010992 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-82tst" Jun 10 20:07:12.547497 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:12.547460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:12.633379 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:12.633344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:19.470126 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:19.470092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:19.571238 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:19.571205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:21.215221 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:21.215188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:21.318933 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:21.318900 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:21.368270 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:21.368238 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:32.937870 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:32.937835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:33.038711 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.038675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:33.546790 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.546759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:33.731406 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.731372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:33.834414 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.834340 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:33.885817 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.885780 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz"] Jun 10 20:07:33.890820 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.890799 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:33.893259 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.893242 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 20:07:33.893446 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.893425 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x75b9\"" Jun 10 20:07:33.893581 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.893563 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 20:07:33.893650 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.893598 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 20:07:33.893650 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.893615 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 20:07:33.902543 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.902507 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz"] Jun 10 20:07:33.974803 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.974771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-manifests\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:33.975169 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.974809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:33.975169 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.974829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8ffx\" (UniqueName: \"kubernetes.io/projected/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-kube-api-access-h8ffx\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:33.975169 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.974868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:33.975169 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:33.974900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-tmp\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.037457 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.037426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:34.075667 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.075643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.075770 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.075672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-tmp\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.075770 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.075727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-manifests\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.075770 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.075744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.075770 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.075763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8ffx\" (UniqueName: \"kubernetes.io/projected/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-kube-api-access-h8ffx\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.076166 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.076142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-manifests\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.077949 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.077926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-tmp\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.078151 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.078135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.078195 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.078177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.083732 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.083714 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8ffx\" (UniqueName: \"kubernetes.io/projected/bc139dff-e96d-49bf-b0ff-d2b3297c79bc-kube-api-access-h8ffx\") pod \"opendatahub-operator-controller-manager-74b5876657-hr9wz\" (UID: \"bc139dff-e96d-49bf-b0ff-d2b3297c79bc\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.141760 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.141729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:34.201994 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.201970 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:34.242182 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.242151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:34.319975 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.319948 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:34.334425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.334400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz"] Jun 10 20:07:34.338103 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:07:34.338074 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc139dff_e96d_49bf_b0ff_d2b3297c79bc.slice/crio-6e97b3960e64812f6758434e9815cb2b9a936d25c2fbdcec887af8f15915aa4e WatchSource:0}: Error finding container 6e97b3960e64812f6758434e9815cb2b9a936d25c2fbdcec887af8f15915aa4e: Status 404 returned error can't find the container with id 6e97b3960e64812f6758434e9815cb2b9a936d25c2fbdcec887af8f15915aa4e Jun 10 20:07:34.380767 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.380742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:34.481173 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.481087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:34.582686 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.582657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:34.682962 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:34.682934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:35.128678 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:35.128641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" event={"ID":"bc139dff-e96d-49bf-b0ff-d2b3297c79bc","Type":"ContainerStarted","Data":"6e97b3960e64812f6758434e9815cb2b9a936d25c2fbdcec887af8f15915aa4e"} Jun 10 20:07:38.145897 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:38.145855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" event={"ID":"bc139dff-e96d-49bf-b0ff-d2b3297c79bc","Type":"ContainerStarted","Data":"b5c3fdf1ba1ebf95c73310743bbf44147667202f5a36adbccb247083307afd85"} Jun 10 20:07:39.151996 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:39.151960 2578 generic.go:356] "Generic (PLEG): container finished" podID="bc139dff-e96d-49bf-b0ff-d2b3297c79bc" containerID="b5c3fdf1ba1ebf95c73310743bbf44147667202f5a36adbccb247083307afd85" exitCode=0 Jun 10 20:07:39.152442 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:39.152037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" event={"ID":"bc139dff-e96d-49bf-b0ff-d2b3297c79bc","Type":"ContainerDied","Data":"b5c3fdf1ba1ebf95c73310743bbf44147667202f5a36adbccb247083307afd85"} Jun 10 20:07:39.593532 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:39.593482 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:39.678079 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:39.678056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:40.165296 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:40.165257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" event={"ID":"bc139dff-e96d-49bf-b0ff-d2b3297c79bc","Type":"ContainerStarted","Data":"8f65cbb1a2b7c3ba7ef3ec55c544735653ad508d3fc60faefcf7df50e6ab81a8"} Jun 10 20:07:40.165707 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:40.165461 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:40.188408 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:40.188355 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" podStartSLOduration=2.9885140850000003 podStartE2EDuration="7.188337788s" totalImagesPullingTime="3.257139414s" totalInitContainerRuntime="942.684289ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:07:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:40.187832464 +0000 UTC m=+485.208462705" watchObservedRunningTime="2026-06-10 20:07:40.188337788 +0000 UTC m=+485.208968021" Jun 10 20:07:51.171797 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:51.171767 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-hr9wz" Jun 10 20:07:52.712568 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:52.712504 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:52.874562 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:52.874503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.025436 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.025352 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.146379 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.146351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.244961 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.244930 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.347052 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.347016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.480681 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.480651 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25"] Jun 10 20:07:53.485939 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.485922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.489000 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.488977 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 20:07:53.489120 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.489006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vm78s\"" Jun 10 20:07:53.489120 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.488977 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 20:07:53.495024 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.495005 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25"] Jun 10 20:07:53.555039 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.555011 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-h6vvh"] Jun 10 20:07:53.557449 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.557430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:53.559740 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.559721 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 20:07:53.559837 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.559790 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mtnbj\"" Jun 10 20:07:53.566761 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.566739 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-h6vvh"] Jun 10 20:07:53.587792 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.587764 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.636498 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.636428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxkm\" (UniqueName: \"kubernetes.io/projected/fc97fc95-eb20-485f-9114-2b3987e945b8-kube-api-access-ggxkm\") pod \"odh-model-controller-6dc94f689f-h6vvh\" (UID: \"fc97fc95-eb20-485f-9114-2b3987e945b8\") " pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:53.636498 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.636473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47bb3a99-efc5-4111-af61-ce33a49d4492-tls-certs\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.636498 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.636496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc97fc95-eb20-485f-9114-2b3987e945b8-cert\") pod \"odh-model-controller-6dc94f689f-h6vvh\" (UID: \"fc97fc95-eb20-485f-9114-2b3987e945b8\") " pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:53.636722 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.636578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tngd\" (UniqueName: \"kubernetes.io/projected/47bb3a99-efc5-4111-af61-ce33a49d4492-kube-api-access-9tngd\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.636722 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.636598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47bb3a99-efc5-4111-af61-ce33a49d4492-tmp\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.680759 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.680733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.738161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.738133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc97fc95-eb20-485f-9114-2b3987e945b8-cert\") pod \"odh-model-controller-6dc94f689f-h6vvh\" (UID: \"fc97fc95-eb20-485f-9114-2b3987e945b8\") " pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:53.738605 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.738193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tngd\" (UniqueName: \"kubernetes.io/projected/47bb3a99-efc5-4111-af61-ce33a49d4492-kube-api-access-9tngd\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.738605 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.738225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47bb3a99-efc5-4111-af61-ce33a49d4492-tmp\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.738605 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.738278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxkm\" (UniqueName: \"kubernetes.io/projected/fc97fc95-eb20-485f-9114-2b3987e945b8-kube-api-access-ggxkm\") pod \"odh-model-controller-6dc94f689f-h6vvh\" (UID: \"fc97fc95-eb20-485f-9114-2b3987e945b8\") " pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:53.738605 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:07:53.738297 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 20:07:53.738605 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.738330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47bb3a99-efc5-4111-af61-ce33a49d4492-tls-certs\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.738605 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:07:53.738390 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc97fc95-eb20-485f-9114-2b3987e945b8-cert podName:fc97fc95-eb20-485f-9114-2b3987e945b8 nodeName:}" failed. No retries permitted until 2026-06-10 20:07:54.238369436 +0000 UTC m=+499.258999665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fc97fc95-eb20-485f-9114-2b3987e945b8-cert") pod "odh-model-controller-6dc94f689f-h6vvh" (UID: "fc97fc95-eb20-485f-9114-2b3987e945b8") : secret "odh-model-controller-webhook-cert" not found Jun 10 20:07:53.740721 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.740700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47bb3a99-efc5-4111-af61-ce33a49d4492-tmp\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.740884 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.740865 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47bb3a99-efc5-4111-af61-ce33a49d4492-tls-certs\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.751119 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.751094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.752500 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.752480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tngd\" (UniqueName: \"kubernetes.io/projected/47bb3a99-efc5-4111-af61-ce33a49d4492-kube-api-access-9tngd\") pod \"kube-auth-proxy-55d4fd5c67-lkm25\" (UID: \"47bb3a99-efc5-4111-af61-ce33a49d4492\") " pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.752847 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.752830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggxkm\" (UniqueName: \"kubernetes.io/projected/fc97fc95-eb20-485f-9114-2b3987e945b8-kube-api-access-ggxkm\") pod \"odh-model-controller-6dc94f689f-h6vvh\" (UID: \"fc97fc95-eb20-485f-9114-2b3987e945b8\") " pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:53.796988 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.796961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" Jun 10 20:07:53.854315 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.854277 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:53.923172 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.923145 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25"] Jun 10 20:07:53.925210 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:07:53.925184 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bb3a99_efc5_4111_af61_ce33a49d4492.slice/crio-aa86703934babc4ac09391325b491d0b5eb74554c42aa29fc8480ff385a10bee WatchSource:0}: Error finding container aa86703934babc4ac09391325b491d0b5eb74554c42aa29fc8480ff385a10bee: Status 404 returned error can't find the container with id aa86703934babc4ac09391325b491d0b5eb74554c42aa29fc8480ff385a10bee Jun 10 20:07:53.994505 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:53.994470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:54.227071 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.226975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" event={"ID":"47bb3a99-efc5-4111-af61-ce33a49d4492","Type":"ContainerStarted","Data":"aa86703934babc4ac09391325b491d0b5eb74554c42aa29fc8480ff385a10bee"} Jun 10 20:07:54.243605 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.243571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc97fc95-eb20-485f-9114-2b3987e945b8-cert\") pod \"odh-model-controller-6dc94f689f-h6vvh\" (UID: \"fc97fc95-eb20-485f-9114-2b3987e945b8\") " pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:54.245888 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.245870 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc97fc95-eb20-485f-9114-2b3987e945b8-cert\") pod \"odh-model-controller-6dc94f689f-h6vvh\" (UID: \"fc97fc95-eb20-485f-9114-2b3987e945b8\") " pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:54.254266 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.254243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:54.275118 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.275090 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5wmzx"] Jun 10 20:07:54.278191 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.278174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.280552 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.280535 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5499j\"" Jun 10 20:07:54.280653 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.280536 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 20:07:54.285604 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.285584 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5wmzx"] Jun 10 20:07:54.433258 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.433224 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:07:54.445418 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.445392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn2rk\" (UniqueName: \"kubernetes.io/projected/9347022a-3914-477d-bc28-c910caa41f78-kube-api-access-tn2rk\") pod \"model-serving-api-5dd488fc48-5wmzx\" (UID: \"9347022a-3914-477d-bc28-c910caa41f78\") " pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.445493 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.445449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9347022a-3914-477d-bc28-c910caa41f78-tls-certs\") pod \"model-serving-api-5dd488fc48-5wmzx\" (UID: \"9347022a-3914-477d-bc28-c910caa41f78\") " pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.468345 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.468324 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:54.546966 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.546927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn2rk\" (UniqueName: \"kubernetes.io/projected/9347022a-3914-477d-bc28-c910caa41f78-kube-api-access-tn2rk\") pod \"model-serving-api-5dd488fc48-5wmzx\" (UID: \"9347022a-3914-477d-bc28-c910caa41f78\") " pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.547139 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.547009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9347022a-3914-477d-bc28-c910caa41f78-tls-certs\") pod \"model-serving-api-5dd488fc48-5wmzx\" (UID: \"9347022a-3914-477d-bc28-c910caa41f78\") " pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.550139 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.550091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9347022a-3914-477d-bc28-c910caa41f78-tls-certs\") pod \"model-serving-api-5dd488fc48-5wmzx\" (UID: \"9347022a-3914-477d-bc28-c910caa41f78\") " pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.555254 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.555209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn2rk\" (UniqueName: \"kubernetes.io/projected/9347022a-3914-477d-bc28-c910caa41f78-kube-api-access-tn2rk\") pod \"model-serving-api-5dd488fc48-5wmzx\" (UID: \"9347022a-3914-477d-bc28-c910caa41f78\") " pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.590037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.589824 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:54.617867 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.617831 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-h6vvh"] Jun 10 20:07:54.622115 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:07:54.622068 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc97fc95_eb20_485f_9114_2b3987e945b8.slice/crio-dd5b312751d348eeb8dec5224117c72575f00c68f3c7ab50160df8711a00982d WatchSource:0}: Error finding container dd5b312751d348eeb8dec5224117c72575f00c68f3c7ab50160df8711a00982d: Status 404 returned error can't find the container with id dd5b312751d348eeb8dec5224117c72575f00c68f3c7ab50160df8711a00982d Jun 10 20:07:54.762211 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:54.761940 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-5wmzx"] Jun 10 20:07:54.765386 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:07:54.765353 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9347022a_3914_477d_bc28_c910caa41f78.slice/crio-9d6a3c9354138ac5cb1f7ce45889a9e7d099e1d3336335c83e2806f157d8d2bf WatchSource:0}: Error finding container 9d6a3c9354138ac5cb1f7ce45889a9e7d099e1d3336335c83e2806f157d8d2bf: Status 404 returned error can't find the container with id 9d6a3c9354138ac5cb1f7ce45889a9e7d099e1d3336335c83e2806f157d8d2bf Jun 10 20:07:55.239736 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:55.239658 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" event={"ID":"fc97fc95-eb20-485f-9114-2b3987e945b8","Type":"ContainerStarted","Data":"dd5b312751d348eeb8dec5224117c72575f00c68f3c7ab50160df8711a00982d"} Jun 10 20:07:55.242391 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:55.242360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" event={"ID":"9347022a-3914-477d-bc28-c910caa41f78","Type":"ContainerStarted","Data":"9d6a3c9354138ac5cb1f7ce45889a9e7d099e1d3336335c83e2806f157d8d2bf"} Jun 10 20:07:59.267467 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.267426 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" event={"ID":"47bb3a99-efc5-4111-af61-ce33a49d4492","Type":"ContainerStarted","Data":"205fb19b7a67dcd8de34db28a8c9678ca765a906982dce2a9808e6675b96f874"} Jun 10 20:07:59.269184 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.269151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" event={"ID":"fc97fc95-eb20-485f-9114-2b3987e945b8","Type":"ContainerStarted","Data":"e825e29e6c5f51aeab03d11b3659117d20f96f1d1ad6f44314516804fc683c75"} Jun 10 20:07:59.269319 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.269303 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:07:59.270639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.270615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" event={"ID":"9347022a-3914-477d-bc28-c910caa41f78","Type":"ContainerStarted","Data":"21899ba9da48f077c95fd528f3480a544dba093c498dda47bb989a8b9bc31086"} Jun 10 20:07:59.270776 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.270760 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:07:59.282878 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.282824 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55d4fd5c67-lkm25" podStartSLOduration=1.549465213 podStartE2EDuration="6.282806091s" totalImagesPullingTime="4.733340878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:59.282494251 +0000 UTC m=+504.303124483" watchObservedRunningTime="2026-06-10 20:07:59.282806091 +0000 UTC m=+504.303436327" Jun 10 20:07:59.298109 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.298063 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" podStartSLOduration=2.2250310349999998 podStartE2EDuration="6.298048948s" totalImagesPullingTime="4.073017913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:59.296972563 +0000 UTC m=+504.317602806" watchObservedRunningTime="2026-06-10 20:07:59.298048948 +0000 UTC m=+504.318679182" Jun 10 20:07:59.313726 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:07:59.313687 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" podStartSLOduration=1.402577208 podStartE2EDuration="5.313674508s" totalImagesPullingTime="3.9110973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:59.311926617 +0000 UTC m=+504.332556840" watchObservedRunningTime="2026-06-10 20:07:59.313674508 +0000 UTC m=+504.334304738" Jun 10 20:08:03.549259 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.549223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:03.612883 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.612844 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-c6h9d"] Jun 10 20:08:03.620251 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.620212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.624052 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.624028 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 20:08:03.624171 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.624054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-b8thq\"" Jun 10 20:08:03.632271 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.632247 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs"] Jun 10 20:08:03.635112 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.635093 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-c6h9d"] Jun 10 20:08:03.635222 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.635174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:03.637472 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.637452 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 20:08:03.637599 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.637456 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2qchl\"" Jun 10 20:08:03.645082 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.645060 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs"] Jun 10 20:08:03.646718 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.646689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:03.729452 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.729411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdcb0197-f8c0-4ea9-9691-062d59f9ef8f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8lxhs\" (UID: \"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:03.729452 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.729452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a238a108-498b-41bc-b603-c0c6c6ca6b3a-cert\") pod \"kserve-controller-manager-69fc866d76-c6h9d\" (UID: \"a238a108-498b-41bc-b603-c0c6c6ca6b3a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.729685 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.729568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llptk\" (UniqueName: \"kubernetes.io/projected/a238a108-498b-41bc-b603-c0c6c6ca6b3a-kube-api-access-llptk\") pod \"kserve-controller-manager-69fc866d76-c6h9d\" (UID: \"a238a108-498b-41bc-b603-c0c6c6ca6b3a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.729685 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.729603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jbp\" (UniqueName: \"kubernetes.io/projected/fdcb0197-f8c0-4ea9-9691-062d59f9ef8f-kube-api-access-h9jbp\") pod \"llmisvc-controller-manager-864bfd7bc9-8lxhs\" (UID: \"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:03.743326 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.743300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:03.830539 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.830441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdcb0197-f8c0-4ea9-9691-062d59f9ef8f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8lxhs\" (UID: \"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:03.830539 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.830472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a238a108-498b-41bc-b603-c0c6c6ca6b3a-cert\") pod \"kserve-controller-manager-69fc866d76-c6h9d\" (UID: \"a238a108-498b-41bc-b603-c0c6c6ca6b3a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.830747 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.830548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llptk\" (UniqueName: \"kubernetes.io/projected/a238a108-498b-41bc-b603-c0c6c6ca6b3a-kube-api-access-llptk\") pod \"kserve-controller-manager-69fc866d76-c6h9d\" (UID: \"a238a108-498b-41bc-b603-c0c6c6ca6b3a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.830747 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.830586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jbp\" (UniqueName: \"kubernetes.io/projected/fdcb0197-f8c0-4ea9-9691-062d59f9ef8f-kube-api-access-h9jbp\") pod \"llmisvc-controller-manager-864bfd7bc9-8lxhs\" (UID: \"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:03.832969 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.832947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdcb0197-f8c0-4ea9-9691-062d59f9ef8f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8lxhs\" (UID: \"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:03.833078 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.833035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a238a108-498b-41bc-b603-c0c6c6ca6b3a-cert\") pod \"kserve-controller-manager-69fc866d76-c6h9d\" (UID: \"a238a108-498b-41bc-b603-c0c6c6ca6b3a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.843470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.843445 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jbp\" (UniqueName: \"kubernetes.io/projected/fdcb0197-f8c0-4ea9-9691-062d59f9ef8f-kube-api-access-h9jbp\") pod \"llmisvc-controller-manager-864bfd7bc9-8lxhs\" (UID: \"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:03.843687 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.843668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llptk\" (UniqueName: \"kubernetes.io/projected/a238a108-498b-41bc-b603-c0c6c6ca6b3a-kube-api-access-llptk\") pod \"kserve-controller-manager-69fc866d76-c6h9d\" (UID: \"a238a108-498b-41bc-b603-c0c6c6ca6b3a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.869543 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.869501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:03.934168 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.934141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:03.946730 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:03.946702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:04.081948 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:04.081919 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-c6h9d"] Jun 10 20:08:04.084734 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:08:04.084707 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda238a108_498b_41bc_b603_c0c6c6ca6b3a.slice/crio-964d7e1cda6e7164a2a78aefade9561ed193c4863b81c2424694e8c73db260e4 WatchSource:0}: Error finding container 964d7e1cda6e7164a2a78aefade9561ed193c4863b81c2424694e8c73db260e4: Status 404 returned error can't find the container with id 964d7e1cda6e7164a2a78aefade9561ed193c4863b81c2424694e8c73db260e4 Jun 10 20:08:04.102048 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:04.102026 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs"] Jun 10 20:08:04.104380 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:08:04.104354 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfdcb0197_f8c0_4ea9_9691_062d59f9ef8f.slice/crio-124c3f4bc10a23457fa713405e745a7cd87e0ca331cab0fe76963d1bc445687f WatchSource:0}: Error finding container 124c3f4bc10a23457fa713405e745a7cd87e0ca331cab0fe76963d1bc445687f: Status 404 returned error can't find the container with id 124c3f4bc10a23457fa713405e745a7cd87e0ca331cab0fe76963d1bc445687f Jun 10 20:08:04.293312 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:04.293283 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" event={"ID":"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f","Type":"ContainerStarted","Data":"124c3f4bc10a23457fa713405e745a7cd87e0ca331cab0fe76963d1bc445687f"} Jun 10 20:08:04.294359 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:04.294335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" event={"ID":"a238a108-498b-41bc-b603-c0c6c6ca6b3a","Type":"ContainerStarted","Data":"964d7e1cda6e7164a2a78aefade9561ed193c4863b81c2424694e8c73db260e4"} Jun 10 20:08:04.817647 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:04.817615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:04.918365 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:04.918337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:05.041391 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:05.041363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:08.316782 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:08.316748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" event={"ID":"fdcb0197-f8c0-4ea9-9691-062d59f9ef8f","Type":"ContainerStarted","Data":"f9dfb0541e8b4e77d246dadfb546c06bbd2430acca5020c160f20880eab06aab"} Jun 10 20:08:08.317235 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:08.316870 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:08.318251 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:08.318230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" event={"ID":"a238a108-498b-41bc-b603-c0c6c6ca6b3a","Type":"ContainerStarted","Data":"0266fa3bbaf91933dee7f2ed96c4e295e102dc3335b8b352f2d0e99641eb8d2f"} Jun 10 20:08:08.318356 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:08.318346 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:08.334470 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:08.334429 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" podStartSLOduration=1.7999314480000002 podStartE2EDuration="5.334417101s" totalImagesPullingTime="3.534485653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:08.333153062 +0000 UTC m=+513.353783294" watchObservedRunningTime="2026-06-10 20:08:08.334417101 +0000 UTC m=+513.355047365" Jun 10 20:08:08.350219 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:08.350178 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" podStartSLOduration=1.846969215 podStartE2EDuration="5.35016522s" totalImagesPullingTime="3.503196005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:08.348351755 +0000 UTC m=+513.368981987" watchObservedRunningTime="2026-06-10 20:08:08.35016522 +0000 UTC m=+513.370795450" Jun 10 20:08:09.600644 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:09.600606 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:09.702378 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:09.702347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:10.276743 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:10.276715 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-h6vvh" Jun 10 20:08:10.279870 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:10.279844 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-5wmzx" Jun 10 20:08:10.934265 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:10.934233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:11.028523 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:11.028481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:11.530425 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:11.530394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:11.629207 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:11.629172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:12.148765 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.148732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:12.315296 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.315258 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw"] Jun 10 20:08:12.322312 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.322288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.324981 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.324959 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-8gwrj\"" Jun 10 20:08:12.324981 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.324972 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 20:08:12.325198 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.325185 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 20:08:12.339677 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.339642 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw"] Jun 10 20:08:12.400558 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.400439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5pfzw\" (UID: \"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.400715 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.400587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8682s\" (UniqueName: \"kubernetes.io/projected/a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9-kube-api-access-8682s\") pod \"servicemesh-operator3-57f65f65fb-5pfzw\" (UID: \"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.501932 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.501893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5pfzw\" (UID: \"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.502084 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.501973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8682s\" (UniqueName: \"kubernetes.io/projected/a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9-kube-api-access-8682s\") pod \"servicemesh-operator3-57f65f65fb-5pfzw\" (UID: \"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.504367 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.504342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5pfzw\" (UID: \"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.511007 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.510986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8682s\" (UniqueName: \"kubernetes.io/projected/a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9-kube-api-access-8682s\") pod \"servicemesh-operator3-57f65f65fb-5pfzw\" (UID: \"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.638997 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.638963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:12.781539 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:12.781489 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw"] Jun 10 20:08:12.784001 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:08:12.783970 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3246d56_eeec_4bf6_a39b_7ba30c4f0bc9.slice/crio-b332c356ac982b1e16798e68e3ceb45d9b13cdba8bcb1617508d9016c4570baa WatchSource:0}: Error finding container b332c356ac982b1e16798e68e3ceb45d9b13cdba8bcb1617508d9016c4570baa: Status 404 returned error can't find the container with id b332c356ac982b1e16798e68e3ceb45d9b13cdba8bcb1617508d9016c4570baa Jun 10 20:08:13.348160 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:13.348125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" event={"ID":"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9","Type":"ContainerStarted","Data":"b332c356ac982b1e16798e68e3ceb45d9b13cdba8bcb1617508d9016c4570baa"} Jun 10 20:08:15.362966 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:15.362922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" event={"ID":"a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9","Type":"ContainerStarted","Data":"e7a51cbbcee283cd3964c42e350d8cc8b8bae1875be932abc5fb93a662a7d167"} Jun 10 20:08:15.363429 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:15.363000 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:15.390293 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:15.390231 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" podStartSLOduration=0.987882281 podStartE2EDuration="3.390207813s" totalImagesPullingTime="2.402325532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:15.386844715 +0000 UTC m=+520.407474948" watchObservedRunningTime="2026-06-10 20:08:15.390207813 +0000 UTC m=+520.410838047" Jun 10 20:08:21.893463 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:21.893425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:21.996480 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:21.996448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:23.594587 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.594551 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56984d5999-4gzsj"] Jun 10 20:08:23.597599 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.597575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:23.600442 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.600418 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9hddz\"" Jun 10 20:08:23.600442 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.600422 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 20:08:23.606268 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.606133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56984d5999-4gzsj"] Jun 10 20:08:23.628376 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.628349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:23.695910 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.695871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cbe1a26b-b175-4506-b2d2-7b721233c926-redirect-config\") pod \"dashboard-redirect-56984d5999-4gzsj\" (UID: \"cbe1a26b-b175-4506-b2d2-7b721233c926\") " pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:23.696083 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.695947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqk9\" (UniqueName: \"kubernetes.io/projected/cbe1a26b-b175-4506-b2d2-7b721233c926-kube-api-access-5cqk9\") pod \"dashboard-redirect-56984d5999-4gzsj\" (UID: \"cbe1a26b-b175-4506-b2d2-7b721233c926\") " pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:23.796861 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.796829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqk9\" (UniqueName: \"kubernetes.io/projected/cbe1a26b-b175-4506-b2d2-7b721233c926-kube-api-access-5cqk9\") pod \"dashboard-redirect-56984d5999-4gzsj\" (UID: \"cbe1a26b-b175-4506-b2d2-7b721233c926\") " pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:23.797004 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.796889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cbe1a26b-b175-4506-b2d2-7b721233c926-redirect-config\") pod \"dashboard-redirect-56984d5999-4gzsj\" (UID: \"cbe1a26b-b175-4506-b2d2-7b721233c926\") " pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:23.797626 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.797608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cbe1a26b-b175-4506-b2d2-7b721233c926-redirect-config\") pod \"dashboard-redirect-56984d5999-4gzsj\" (UID: \"cbe1a26b-b175-4506-b2d2-7b721233c926\") " pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:23.804639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.804619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqk9\" (UniqueName: \"kubernetes.io/projected/cbe1a26b-b175-4506-b2d2-7b721233c926-kube-api-access-5cqk9\") pod \"dashboard-redirect-56984d5999-4gzsj\" (UID: \"cbe1a26b-b175-4506-b2d2-7b721233c926\") " pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:23.909995 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:23.909911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" Jun 10 20:08:24.036726 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:24.036693 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56984d5999-4gzsj"] Jun 10 20:08:24.040631 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:08:24.040603 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe1a26b_b175_4506_b2d2_7b721233c926.slice/crio-d41ab291a833d3680156dc78bfe01876c46574995767362516c0c924371909e6 WatchSource:0}: Error finding container d41ab291a833d3680156dc78bfe01876c46574995767362516c0c924371909e6: Status 404 returned error can't find the container with id d41ab291a833d3680156dc78bfe01876c46574995767362516c0c924371909e6 Jun 10 20:08:24.408910 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:24.408873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" event={"ID":"cbe1a26b-b175-4506-b2d2-7b721233c926","Type":"ContainerStarted","Data":"d41ab291a833d3680156dc78bfe01876c46574995767362516c0c924371909e6"} Jun 10 20:08:26.371461 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:26.371387 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5pfzw" Jun 10 20:08:30.443994 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:30.443954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" event={"ID":"cbe1a26b-b175-4506-b2d2-7b721233c926","Type":"ContainerStarted","Data":"f0e52f1034a0dd8778a836acd14c2eb2d6c8fa65f71ec1cae5ce9c72067964c4"} Jun 10 20:08:30.459270 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:30.459224 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56984d5999-4gzsj" podStartSLOduration=1.990157851 podStartE2EDuration="7.45921026s" totalImagesPullingTime="5.469052409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:30.458337815 +0000 UTC m=+535.478968038" watchObservedRunningTime="2026-06-10 20:08:30.45921026 +0000 UTC m=+535.479840491" Jun 10 20:08:37.327378 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.327341 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65"] Jun 10 20:08:37.329245 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.329222 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:37.332394 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.332373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.334869 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.334848 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 20:08:37.334979 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.334891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ks2rl\"" Jun 10 20:08:37.334979 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.334942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 20:08:37.334979 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.334971 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 20:08:37.335150 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.335093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 20:08:37.343641 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.343620 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65"] Jun 10 20:08:37.387695 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.387664 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:37.420933 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.420896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.421110 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.420943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cd66\" (UniqueName: \"kubernetes.io/projected/65b2710d-96bf-42a3-80df-e1cc3f46d68a-kube-api-access-8cd66\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.421110 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.420978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.421110 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.421002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.421110 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.421015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.421110 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.421092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.421370 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.421132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b2710d-96bf-42a3-80df-e1cc3f46d68a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522132 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522132 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cd66\" (UniqueName: \"kubernetes.io/projected/65b2710d-96bf-42a3-80df-e1cc3f46d68a-kube-api-access-8cd66\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522396 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522396 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522396 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522396 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522396 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b2710d-96bf-42a3-80df-e1cc3f46d68a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.522930 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.522907 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.524697 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.524677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.524790 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.524694 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.524832 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.524780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/65b2710d-96bf-42a3-80df-e1cc3f46d68a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.524947 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.524932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b2710d-96bf-42a3-80df-e1cc3f46d68a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.530190 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.530166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cd66\" (UniqueName: \"kubernetes.io/projected/65b2710d-96bf-42a3-80df-e1cc3f46d68a-kube-api-access-8cd66\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.530465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.530445 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b2710d-96bf-42a3-80df-e1cc3f46d68a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fcn65\" (UID: \"65b2710d-96bf-42a3-80df-e1cc3f46d68a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.641942 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.641918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:37.777836 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.777813 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65"] Jun 10 20:08:37.780397 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:08:37.780366 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b2710d_96bf_42a3_80df_e1cc3f46d68a.slice/crio-683de18c2d79fbda7ca8578de75842a5fe323ac13fda4ef128564cc517877802 WatchSource:0}: Error finding container 683de18c2d79fbda7ca8578de75842a5fe323ac13fda4ef128564cc517877802: Status 404 returned error can't find the container with id 683de18c2d79fbda7ca8578de75842a5fe323ac13fda4ef128564cc517877802 Jun 10 20:08:37.943286 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:37.943211 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:38.481486 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:38.481452 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" event={"ID":"65b2710d-96bf-42a3-80df-e1cc3f46d68a","Type":"ContainerStarted","Data":"683de18c2d79fbda7ca8578de75842a5fe323ac13fda4ef128564cc517877802"} Jun 10 20:08:39.325014 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:39.324983 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8lxhs" Jun 10 20:08:39.328763 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:39.328739 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-c6h9d" Jun 10 20:08:44.267135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:44.267097 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 20:08:44.267491 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:44.267174 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 20:08:44.510983 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:44.510945 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" event={"ID":"65b2710d-96bf-42a3-80df-e1cc3f46d68a","Type":"ContainerStarted","Data":"9e855e12c62ff4e8ec5defbc91fd352725366b591f54883feef285fbdd761bd9"} Jun 10 20:08:44.511185 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:44.511017 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:44.530999 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:44.530893 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" podStartSLOduration=1.04642763 podStartE2EDuration="7.530878382s" totalImagesPullingTime="6.484450752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:44.530869822 +0000 UTC m=+549.551500053" watchObservedRunningTime="2026-06-10 20:08:44.530878382 +0000 UTC m=+549.551508612" Jun 10 20:08:44.903725 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:44.903685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:45.002384 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:45.002345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:45.206270 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:45.206185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:45.410756 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:45.410732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:45.510768 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:45.510686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:45.518177 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:45.518147 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fcn65" Jun 10 20:08:45.703062 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:45.703028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:54.211806 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:54.211747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:54.308283 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:54.308254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:54.370172 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:54.370139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:55.131150 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:55.131119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:08:55.329713 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:08:55.329686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:19.366135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:19.366098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:23.660644 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:23.660609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:24.982625 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:24.982597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:26.211214 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.211182 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5"] Jun 10 20:09:26.213867 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.213849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" Jun 10 20:09:26.221559 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.221538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 20:09:26.221864 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.221846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-49nbv\"" Jun 10 20:09:26.221942 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.221872 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 20:09:26.221942 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.221931 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 20:09:26.237211 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.237190 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5"] Jun 10 20:09:26.332802 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.332764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2zp\" (UniqueName: \"kubernetes.io/projected/c9154d88-161e-4a6f-b59b-f071c249785c-kube-api-access-wk2zp\") pod \"dns-operator-controller-manager-864dd78c4c-6mbs5\" (UID: \"c9154d88-161e-4a6f-b59b-f071c249785c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" Jun 10 20:09:26.434238 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.434199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2zp\" (UniqueName: \"kubernetes.io/projected/c9154d88-161e-4a6f-b59b-f071c249785c-kube-api-access-wk2zp\") pod \"dns-operator-controller-manager-864dd78c4c-6mbs5\" (UID: \"c9154d88-161e-4a6f-b59b-f071c249785c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" Jun 10 20:09:26.444846 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.444817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2zp\" (UniqueName: \"kubernetes.io/projected/c9154d88-161e-4a6f-b59b-f071c249785c-kube-api-access-wk2zp\") pod \"dns-operator-controller-manager-864dd78c4c-6mbs5\" (UID: \"c9154d88-161e-4a6f-b59b-f071c249785c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" Jun 10 20:09:26.524350 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.524275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" Jun 10 20:09:26.568242 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.568211 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:26.663625 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.663594 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5"] Jun 10 20:09:26.666643 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:09:26.666622 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9154d88_161e_4a6f_b59b_f071c249785c.slice/crio-d702d8e1d5fb6ef72eca1776e26158fd02f43b72b90b0354c3eb2f498b052b0d WatchSource:0}: Error finding container d702d8e1d5fb6ef72eca1776e26158fd02f43b72b90b0354c3eb2f498b052b0d: Status 404 returned error can't find the container with id d702d8e1d5fb6ef72eca1776e26158fd02f43b72b90b0354c3eb2f498b052b0d Jun 10 20:09:26.713749 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.713720 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" event={"ID":"c9154d88-161e-4a6f-b59b-f071c249785c","Type":"ContainerStarted","Data":"d702d8e1d5fb6ef72eca1776e26158fd02f43b72b90b0354c3eb2f498b052b0d"} Jun 10 20:09:26.968968 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:26.968939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:27.271227 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:27.271160 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:29.584493 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.584461 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7"] Jun 10 20:09:29.587962 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.587947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" Jun 10 20:09:29.590250 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.590228 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dqkzg\"" Jun 10 20:09:29.597017 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.596987 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7"] Jun 10 20:09:29.665751 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.665718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzljg\" (UniqueName: \"kubernetes.io/projected/89059fac-989b-425f-bf46-ea02a02323c7-kube-api-access-hzljg\") pod \"authorino-operator-75cc8d5cb7-hcfz7\" (UID: \"89059fac-989b-425f-bf46-ea02a02323c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" Jun 10 20:09:29.730951 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.730920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" event={"ID":"c9154d88-161e-4a6f-b59b-f071c249785c","Type":"ContainerStarted","Data":"0f387a28d4d228a86f05d4694b0bd84de990781b0f4cbed6567313c7e037c187"} Jun 10 20:09:29.731100 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.731040 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" Jun 10 20:09:29.747679 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.747635 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" podStartSLOduration=1.64868773 podStartE2EDuration="3.747621198s" totalImagesPullingTime="2.098933468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:29.746309955 +0000 UTC m=+594.766940197" watchObservedRunningTime="2026-06-10 20:09:29.747621198 +0000 UTC m=+594.768251429" Jun 10 20:09:29.766961 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.766933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzljg\" (UniqueName: \"kubernetes.io/projected/89059fac-989b-425f-bf46-ea02a02323c7-kube-api-access-hzljg\") pod \"authorino-operator-75cc8d5cb7-hcfz7\" (UID: \"89059fac-989b-425f-bf46-ea02a02323c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" Jun 10 20:09:29.777696 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.777658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzljg\" (UniqueName: \"kubernetes.io/projected/89059fac-989b-425f-bf46-ea02a02323c7-kube-api-access-hzljg\") pod \"authorino-operator-75cc8d5cb7-hcfz7\" (UID: \"89059fac-989b-425f-bf46-ea02a02323c7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" Jun 10 20:09:29.898153 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:29.898129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" Jun 10 20:09:30.031479 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:30.031451 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7"] Jun 10 20:09:30.034123 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:09:30.034093 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89059fac_989b_425f_bf46_ea02a02323c7.slice/crio-2fcd29555df3b9c2ad17c3ae8d46a9b7c6216837ab14c718224392aa7ccfad76 WatchSource:0}: Error finding container 2fcd29555df3b9c2ad17c3ae8d46a9b7c6216837ab14c718224392aa7ccfad76: Status 404 returned error can't find the container with id 2fcd29555df3b9c2ad17c3ae8d46a9b7c6216837ab14c718224392aa7ccfad76 Jun 10 20:09:30.171159 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:30.171068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:30.737381 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:30.737346 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" event={"ID":"89059fac-989b-425f-bf46-ea02a02323c7","Type":"ContainerStarted","Data":"2fcd29555df3b9c2ad17c3ae8d46a9b7c6216837ab14c718224392aa7ccfad76"} Jun 10 20:09:30.832101 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:30.832054 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:30.938756 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:30.938721 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:32.749914 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:32.749876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" event={"ID":"89059fac-989b-425f-bf46-ea02a02323c7","Type":"ContainerStarted","Data":"bdbd9e3ccb380d6e4e7ab37d57088ec07ef2cabda654ba3c3a5f72daa3f3cb96"} Jun 10 20:09:32.750332 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:32.749962 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" Jun 10 20:09:32.766465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:32.766418 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" podStartSLOduration=1.4771497820000001 podStartE2EDuration="3.766402417s" totalImagesPullingTime="2.289252635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:32.764442572 +0000 UTC m=+597.785072804" watchObservedRunningTime="2026-06-10 20:09:32.766402417 +0000 UTC m=+597.787032648" Jun 10 20:09:33.656398 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:33.656365 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:34.376400 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:34.376364 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:34.455314 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:34.455290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:35.192705 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:35.192674 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:35.396997 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:35.396967 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:09:35.398173 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:35.398149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:09:35.527648 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:35.527561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:35.986147 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:35.986097 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc68cff98-4swmc"] Jun 10 20:09:35.989997 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:35.989976 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.002191 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.002168 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc68cff98-4swmc"] Jun 10 20:09:36.034531 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.034480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:36.124622 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.124575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-oauth-serving-cert\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.124811 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.124635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-oauth-config\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.124811 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.124663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-service-ca\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.124811 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.124719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-config\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.124811 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.124776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b79g2\" (UniqueName: \"kubernetes.io/projected/755a94a8-a6fc-4566-99fc-584f54a4caf8-kube-api-access-b79g2\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.125013 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.124821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-trusted-ca-bundle\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.125013 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.124856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-serving-cert\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.134269 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.134230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:36.226159 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.226130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-serving-cert\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.226339 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.226180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-oauth-serving-cert\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.226409 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.226352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-oauth-config\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.226409 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.226381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-service-ca\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.226551 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.226417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-config\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.226551 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.226479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b79g2\" (UniqueName: \"kubernetes.io/projected/755a94a8-a6fc-4566-99fc-584f54a4caf8-kube-api-access-b79g2\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.226683 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.226632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-trusted-ca-bundle\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.227102 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.227076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-oauth-serving-cert\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.227280 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.227248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-config\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.227450 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.227432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-trusted-ca-bundle\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.227792 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.227772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755a94a8-a6fc-4566-99fc-584f54a4caf8-service-ca\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.228713 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.228695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-oauth-config\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.228994 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.228977 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755a94a8-a6fc-4566-99fc-584f54a4caf8-console-serving-cert\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.233610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.233589 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b79g2\" (UniqueName: \"kubernetes.io/projected/755a94a8-a6fc-4566-99fc-584f54a4caf8-kube-api-access-b79g2\") pod \"console-fc68cff98-4swmc\" (UID: \"755a94a8-a6fc-4566-99fc-584f54a4caf8\") " pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.234451 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.234431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:36.301843 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.301757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:36.440230 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.440135 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc68cff98-4swmc"] Jun 10 20:09:36.442479 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:09:36.442449 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755a94a8_a6fc_4566_99fc_584f54a4caf8.slice/crio-bdd9be2c4cc8cfa4effdb560b729ff393b34588f7696e5941078d4a180c82a12 WatchSource:0}: Error finding container bdd9be2c4cc8cfa4effdb560b729ff393b34588f7696e5941078d4a180c82a12: Status 404 returned error can't find the container with id bdd9be2c4cc8cfa4effdb560b729ff393b34588f7696e5941078d4a180c82a12 Jun 10 20:09:36.771180 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.771144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc68cff98-4swmc" event={"ID":"755a94a8-a6fc-4566-99fc-584f54a4caf8","Type":"ContainerStarted","Data":"a822ca672e6da15f700d704e2d0f14d84422493c494a6280c7c616c88f1e0b1f"} Jun 10 20:09:36.771333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.771202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc68cff98-4swmc" event={"ID":"755a94a8-a6fc-4566-99fc-584f54a4caf8","Type":"ContainerStarted","Data":"bdd9be2c4cc8cfa4effdb560b729ff393b34588f7696e5941078d4a180c82a12"} Jun 10 20:09:36.788304 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.788255 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc68cff98-4swmc" podStartSLOduration=1.7882408939999999 podStartE2EDuration="1.788240894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:36.787099079 +0000 UTC m=+601.807729312" watchObservedRunningTime="2026-06-10 20:09:36.788240894 +0000 UTC m=+601.808871124" Jun 10 20:09:36.791397 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.791366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:36.891631 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:36.891596 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:40.740116 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:40.740085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mbs5" Jun 10 20:09:41.089263 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:41.089235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:42.385080 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:42.385038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:42.485934 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:42.485901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:43.757366 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:43.757340 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hcfz7" Jun 10 20:09:46.302684 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:46.302643 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:46.303164 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:46.302796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:46.307458 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:46.307432 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:46.824555 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:46.824528 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc68cff98-4swmc" Jun 10 20:09:46.883348 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:46.883308 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-586f458b5-bjqfp"] Jun 10 20:09:46.995909 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:46.995882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:47.095950 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:47.095917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:47.211271 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:47.211225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:47.313502 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:47.313468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:48.377185 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:48.377154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:48.477849 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:48.477818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:48.973790 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:48.973758 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:49.073271 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:49.073241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:52.775397 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:52.775353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:52.875161 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:52.875128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:57.371623 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:57.371546 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:09:57.432783 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:09:57.432754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:04.915770 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:04.915735 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:04.969020 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:04.968988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:05.369488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:05.369446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:05.427790 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:05.427756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:10.975166 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:10.975133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:11.072097 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:11.072067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:11.188264 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:11.188236 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:11.905250 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:11.905183 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-586f458b5-bjqfp" podUID="ecb0290f-9b66-4457-a654-9aa347ab7d67" containerName="console" containerID="cri-o://11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386" gracePeriod=15 Jun 10 20:10:12.167657 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.167599 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:10:12.235812 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.235780 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxjfv\" (UniqueName: \"kubernetes.io/projected/ecb0290f-9b66-4457-a654-9aa347ab7d67-kube-api-access-cxjfv\") pod \"ecb0290f-9b66-4457-a654-9aa347ab7d67\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " Jun 10 20:10:12.235985 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.235821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-oauth-serving-cert\") pod \"ecb0290f-9b66-4457-a654-9aa347ab7d67\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " Jun 10 20:10:12.235985 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.235837 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-service-ca\") pod \"ecb0290f-9b66-4457-a654-9aa347ab7d67\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " Jun 10 20:10:12.235985 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.235938 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-config\") pod \"ecb0290f-9b66-4457-a654-9aa347ab7d67\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " Jun 10 20:10:12.236157 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236057 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-serving-cert\") pod \"ecb0290f-9b66-4457-a654-9aa347ab7d67\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " Jun 10 20:10:12.236157 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236122 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-trusted-ca-bundle\") pod \"ecb0290f-9b66-4457-a654-9aa347ab7d67\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " Jun 10 20:10:12.236157 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236153 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-oauth-config\") pod \"ecb0290f-9b66-4457-a654-9aa347ab7d67\" (UID: \"ecb0290f-9b66-4457-a654-9aa347ab7d67\") " Jun 10 20:10:12.236297 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236218 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ecb0290f-9b66-4457-a654-9aa347ab7d67" (UID: "ecb0290f-9b66-4457-a654-9aa347ab7d67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:10:12.236297 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236279 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-config" (OuterVolumeSpecName: "console-config") pod "ecb0290f-9b66-4457-a654-9aa347ab7d67" (UID: "ecb0290f-9b66-4457-a654-9aa347ab7d67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:10:12.236403 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236292 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-service-ca" (OuterVolumeSpecName: "service-ca") pod "ecb0290f-9b66-4457-a654-9aa347ab7d67" (UID: "ecb0290f-9b66-4457-a654-9aa347ab7d67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:10:12.236559 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236541 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-oauth-serving-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:12.236635 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236565 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-service-ca\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:12.236635 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236579 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-config\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:12.236635 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.236569 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ecb0290f-9b66-4457-a654-9aa347ab7d67" (UID: "ecb0290f-9b66-4457-a654-9aa347ab7d67"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:10:12.238037 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.238011 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb0290f-9b66-4457-a654-9aa347ab7d67-kube-api-access-cxjfv" (OuterVolumeSpecName: "kube-api-access-cxjfv") pod "ecb0290f-9b66-4457-a654-9aa347ab7d67" (UID: "ecb0290f-9b66-4457-a654-9aa347ab7d67"). InnerVolumeSpecName "kube-api-access-cxjfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:10:12.238156 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.238134 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ecb0290f-9b66-4457-a654-9aa347ab7d67" (UID: "ecb0290f-9b66-4457-a654-9aa347ab7d67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:10:12.238218 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.238150 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ecb0290f-9b66-4457-a654-9aa347ab7d67" (UID: "ecb0290f-9b66-4457-a654-9aa347ab7d67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:10:12.337704 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.337672 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-serving-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:12.337704 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.337697 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb0290f-9b66-4457-a654-9aa347ab7d67-trusted-ca-bundle\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:12.337704 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.337706 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb0290f-9b66-4457-a654-9aa347ab7d67-console-oauth-config\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:12.337932 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.337715 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxjfv\" (UniqueName: \"kubernetes.io/projected/ecb0290f-9b66-4457-a654-9aa347ab7d67-kube-api-access-cxjfv\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:12.957860 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.957825 2578 generic.go:356] "Generic (PLEG): container finished" podID="ecb0290f-9b66-4457-a654-9aa347ab7d67" containerID="11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386" exitCode=0 Jun 10 20:10:12.958039 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.957874 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-586f458b5-bjqfp" Jun 10 20:10:12.958039 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.957912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-586f458b5-bjqfp" event={"ID":"ecb0290f-9b66-4457-a654-9aa347ab7d67","Type":"ContainerDied","Data":"11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386"} Jun 10 20:10:12.958039 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.957966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-586f458b5-bjqfp" event={"ID":"ecb0290f-9b66-4457-a654-9aa347ab7d67","Type":"ContainerDied","Data":"48448f9834cf586e12324190e237d76400d95f7c8f62952def57cf7b5ad14740"} Jun 10 20:10:12.958039 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.957987 2578 scope.go:117] "RemoveContainer" containerID="11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386" Jun 10 20:10:12.967584 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.967565 2578 scope.go:117] "RemoveContainer" containerID="11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386" Jun 10 20:10:12.967814 ip-10-0-138-104 kubenswrapper[2578]: E0610 20:10:12.967798 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386\": container with ID starting with 11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386 not found: ID does not exist" containerID="11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386" Jun 10 20:10:12.967874 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.967821 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386"} err="failed to get container status \"11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386\": rpc error: code = NotFound desc = could not find container \"11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386\": container with ID starting with 11af665d1ad38fa616cd4a8670207d8f6890d114db918efad20b41964131b386 not found: ID does not exist" Jun 10 20:10:12.979940 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.979882 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-586f458b5-bjqfp"] Jun 10 20:10:12.981780 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:12.981761 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-586f458b5-bjqfp"] Jun 10 20:10:13.425326 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:13.425288 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb0290f-9b66-4457-a654-9aa347ab7d67" path="/var/lib/kubelet/pods/ecb0290f-9b66-4457-a654-9aa347ab7d67/volumes" Jun 10 20:10:13.973287 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:13.973258 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:14.077433 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:14.077404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:14.871179 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:14.871143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:14.924340 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:14.924307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:17.461702 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:17.461672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:17.984427 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:17.984387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:18.085093 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:18.085052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:18.678848 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:18.678817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:25.192323 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:25.192290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:25.798910 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:25.798862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:25.861698 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:25.861654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:28.783636 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.783587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:28.789739 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.789716 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdr5"] Jun 10 20:10:28.790173 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.790156 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb0290f-9b66-4457-a654-9aa347ab7d67" containerName="console" Jun 10 20:10:28.790268 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.790176 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb0290f-9b66-4457-a654-9aa347ab7d67" containerName="console" Jun 10 20:10:28.790325 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.790309 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb0290f-9b66-4457-a654-9aa347ab7d67" containerName="console" Jun 10 20:10:28.793437 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.793418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:28.795803 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.795780 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 20:10:28.795934 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.795911 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ls4tn\"" Jun 10 20:10:28.801410 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.801390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdr5"] Jun 10 20:10:28.888410 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.888376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstp7\" (UniqueName: \"kubernetes.io/projected/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-kube-api-access-jstp7\") pod \"limitador-limitador-64c94fd64f-spdr5\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:28.888610 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.888534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-config-file\") pod \"limitador-limitador-64c94fd64f-spdr5\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:28.888841 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.888824 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdr5"] Jun 10 20:10:28.891625 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.891591 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:28.969711 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.969682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:28.989753 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.989723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-config-file\") pod \"limitador-limitador-64c94fd64f-spdr5\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:28.989904 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.989810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstp7\" (UniqueName: \"kubernetes.io/projected/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-kube-api-access-jstp7\") pod \"limitador-limitador-64c94fd64f-spdr5\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:28.990333 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.990314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-config-file\") pod \"limitador-limitador-64c94fd64f-spdr5\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:28.998575 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:28.998545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstp7\" (UniqueName: \"kubernetes.io/projected/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-kube-api-access-jstp7\") pod \"limitador-limitador-64c94fd64f-spdr5\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:29.103631 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:29.103599 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:29.240605 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:29.240580 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdr5"] Jun 10 20:10:29.242579 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:10:29.242552 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5540eb54_4a48_4ffb_9e81_fd0a5fb6d90b.slice/crio-7ad36c094d8d873a779ea404e09494e3ea082fd1e150808bd92aea2ce7981fbc WatchSource:0}: Error finding container 7ad36c094d8d873a779ea404e09494e3ea082fd1e150808bd92aea2ce7981fbc: Status 404 returned error can't find the container with id 7ad36c094d8d873a779ea404e09494e3ea082fd1e150808bd92aea2ce7981fbc Jun 10 20:10:29.619699 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:29.619658 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:29.679135 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:29.679110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:30.046465 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:30.046364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" event={"ID":"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b","Type":"ContainerStarted","Data":"7ad36c094d8d873a779ea404e09494e3ea082fd1e150808bd92aea2ce7981fbc"} Jun 10 20:10:31.409785 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:31.409752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:31.523422 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:31.523386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:32.060432 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:32.060391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" event={"ID":"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b","Type":"ContainerStarted","Data":"17993c3b813a4fa92be9d22070916784060bd5e0b33f1162a3e90fbc841cdcdf"} Jun 10 20:10:32.060618 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:32.060505 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:32.080229 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:32.080180 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" podStartSLOduration=1.40340762 podStartE2EDuration="4.080163366s" totalImagesPullingTime="2.676755746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:10:32.079346983 +0000 UTC m=+657.099977217" watchObservedRunningTime="2026-06-10 20:10:32.080163366 +0000 UTC m=+657.100793596" Jun 10 20:10:34.406218 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:34.406168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:34.506415 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:34.506379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:40.335644 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:40.335613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:40.388122 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:40.388090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:43.065824 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:43.065797 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:45.617192 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:45.617160 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdr5"] Jun 10 20:10:45.617685 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:45.617322 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" podUID="5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" containerName="limitador" containerID="cri-o://17993c3b813a4fa92be9d22070916784060bd5e0b33f1162a3e90fbc841cdcdf" gracePeriod=30 Jun 10 20:10:45.790273 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:45.790243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:46.128112 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.128083 2578 generic.go:356] "Generic (PLEG): container finished" podID="5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" containerID="17993c3b813a4fa92be9d22070916784060bd5e0b33f1162a3e90fbc841cdcdf" exitCode=0 Jun 10 20:10:46.128285 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.128127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" event={"ID":"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b","Type":"ContainerDied","Data":"17993c3b813a4fa92be9d22070916784060bd5e0b33f1162a3e90fbc841cdcdf"} Jun 10 20:10:46.170375 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.170353 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:46.348168 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.348138 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-config-file\") pod \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " Jun 10 20:10:46.348351 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.348193 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jstp7\" (UniqueName: \"kubernetes.io/projected/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-kube-api-access-jstp7\") pod \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\" (UID: \"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b\") " Jun 10 20:10:46.348535 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.348498 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-config-file" (OuterVolumeSpecName: "config-file") pod "5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" (UID: "5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:10:46.350410 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.350391 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-kube-api-access-jstp7" (OuterVolumeSpecName: "kube-api-access-jstp7") pod "5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" (UID: "5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b"). InnerVolumeSpecName "kube-api-access-jstp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:10:46.449217 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.449183 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-config-file\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:46.449217 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:46.449209 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jstp7\" (UniqueName: \"kubernetes.io/projected/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b-kube-api-access-jstp7\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\"" Jun 10 20:10:47.134258 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:47.134216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" event={"ID":"5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b","Type":"ContainerDied","Data":"7ad36c094d8d873a779ea404e09494e3ea082fd1e150808bd92aea2ce7981fbc"} Jun 10 20:10:47.134674 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:47.134232 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-spdr5" Jun 10 20:10:47.134674 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:47.134322 2578 scope.go:117] "RemoveContainer" containerID="17993c3b813a4fa92be9d22070916784060bd5e0b33f1162a3e90fbc841cdcdf" Jun 10 20:10:47.155299 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:47.155277 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdr5"] Jun 10 20:10:47.158747 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:47.158726 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-spdr5"] Jun 10 20:10:47.424890 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:47.424810 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" path="/var/lib/kubelet/pods/5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b/volumes" Jun 10 20:10:50.485912 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.485878 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-cxdxb"] Jun 10 20:10:50.486481 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.486264 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" containerName="limitador" Jun 10 20:10:50.486481 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.486277 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" containerName="limitador" Jun 10 20:10:50.486481 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.486346 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5540eb54-4a48-4ffb-9e81-fd0a5fb6d90b" containerName="limitador" Jun 10 20:10:50.490814 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.490793 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.493190 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.493170 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 10 20:10:50.496173 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.496153 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cxdxb"] Jun 10 20:10:50.535724 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.535697 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:10:50.587197 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.587168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpqh\" (UniqueName: \"kubernetes.io/projected/e914c404-14a6-4e75-8aff-2f7879123859-kube-api-access-jwpqh\") pod \"postgres-69fb4594cf-cxdxb\" (UID: \"e914c404-14a6-4e75-8aff-2f7879123859\") " pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.587362 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.587205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e914c404-14a6-4e75-8aff-2f7879123859-data\") pod \"postgres-69fb4594cf-cxdxb\" (UID: \"e914c404-14a6-4e75-8aff-2f7879123859\") " pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.688548 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.688473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpqh\" (UniqueName: \"kubernetes.io/projected/e914c404-14a6-4e75-8aff-2f7879123859-kube-api-access-jwpqh\") pod \"postgres-69fb4594cf-cxdxb\" (UID: \"e914c404-14a6-4e75-8aff-2f7879123859\") " pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.688548 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.688549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e914c404-14a6-4e75-8aff-2f7879123859-data\") pod \"postgres-69fb4594cf-cxdxb\" (UID: \"e914c404-14a6-4e75-8aff-2f7879123859\") " pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.688867 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.688851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e914c404-14a6-4e75-8aff-2f7879123859-data\") pod \"postgres-69fb4594cf-cxdxb\" (UID: \"e914c404-14a6-4e75-8aff-2f7879123859\") " pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.697698 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.697676 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpqh\" (UniqueName: \"kubernetes.io/projected/e914c404-14a6-4e75-8aff-2f7879123859-kube-api-access-jwpqh\") pod \"postgres-69fb4594cf-cxdxb\" (UID: \"e914c404-14a6-4e75-8aff-2f7879123859\") " pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.803713 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.803612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:10:50.932612 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.932586 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cxdxb"] Jun 10 20:10:50.934608 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:10:50.934573 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode914c404_14a6_4e75_8aff_2f7879123859.slice/crio-9858b1105b2433c3c555bad496ce8e4194b596fe4fc06664103963daf6c60c6b WatchSource:0}: Error finding container 9858b1105b2433c3c555bad496ce8e4194b596fe4fc06664103963daf6c60c6b: Status 404 returned error can't find the container with id 9858b1105b2433c3c555bad496ce8e4194b596fe4fc06664103963daf6c60c6b Jun 10 20:10:50.935985 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:50.935967 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:10:51.156088 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:51.156056 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cxdxb" event={"ID":"e914c404-14a6-4e75-8aff-2f7879123859","Type":"ContainerStarted","Data":"9858b1105b2433c3c555bad496ce8e4194b596fe4fc06664103963daf6c60c6b"} Jun 10 20:10:54.175899 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:54.175861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cxdxb" event={"ID":"e914c404-14a6-4e75-8aff-2f7879123859","Type":"ContainerStarted","Data":"d5f61c890237c0fdf86363e9bdc73f0452b957e96a52b8adfb6bb00f3c5eb382"} Jun 10 20:10:54.176327 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:10:54.175995 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:11:00.216567 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:00.216538 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-cxdxb" Jun 10 20:11:00.232458 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:00.232411 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-cxdxb" podStartSLOduration=7.529691461 podStartE2EDuration="10.232397201s" totalImagesPullingTime="2.70270574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:10:54.195480195 +0000 UTC m=+679.216110426" watchObservedRunningTime="2026-06-10 20:11:00.232397201 +0000 UTC m=+685.253027432" Jun 10 20:11:00.511712 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:00.511632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:00.613219 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:00.613186 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:00.766915 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:00.766836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:09.073906 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.073871 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-djq44"] Jun 10 20:11:09.081489 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.081456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" Jun 10 20:11:09.084064 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.084036 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 20:11:09.084415 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.084400 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-pmhmf\"" Jun 10 20:11:09.085072 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.085058 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 20:11:09.090112 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.090090 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-djq44"] Jun 10 20:11:09.149853 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.149821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97gbv\" (UniqueName: \"kubernetes.io/projected/649c8057-d25f-448a-96bf-93eb21e14733-kube-api-access-97gbv\") pod \"keycloak-operator-d67dbbb48-djq44\" (UID: \"649c8057-d25f-448a-96bf-93eb21e14733\") " pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" Jun 10 20:11:09.250773 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.250743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97gbv\" (UniqueName: \"kubernetes.io/projected/649c8057-d25f-448a-96bf-93eb21e14733-kube-api-access-97gbv\") pod \"keycloak-operator-d67dbbb48-djq44\" (UID: \"649c8057-d25f-448a-96bf-93eb21e14733\") " pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" Jun 10 20:11:09.265347 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.265320 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97gbv\" (UniqueName: \"kubernetes.io/projected/649c8057-d25f-448a-96bf-93eb21e14733-kube-api-access-97gbv\") pod \"keycloak-operator-d67dbbb48-djq44\" (UID: \"649c8057-d25f-448a-96bf-93eb21e14733\") " pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" Jun 10 20:11:09.392766 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.392734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" Jun 10 20:11:09.528233 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:09.528213 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-djq44"] Jun 10 20:11:09.530660 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:11:09.530633 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649c8057_d25f_448a_96bf_93eb21e14733.slice/crio-2277712a8b9899f24518e41c226f5ee548a5787c0f9085c7b6582470fedeb19f WatchSource:0}: Error finding container 2277712a8b9899f24518e41c226f5ee548a5787c0f9085c7b6582470fedeb19f: Status 404 returned error can't find the container with id 2277712a8b9899f24518e41c226f5ee548a5787c0f9085c7b6582470fedeb19f Jun 10 20:11:10.264000 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:10.263963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" event={"ID":"649c8057-d25f-448a-96bf-93eb21e14733","Type":"ContainerStarted","Data":"2277712a8b9899f24518e41c226f5ee548a5787c0f9085c7b6582470fedeb19f"} Jun 10 20:11:16.300138 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:16.300100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" event={"ID":"649c8057-d25f-448a-96bf-93eb21e14733","Type":"ContainerStarted","Data":"771163cf25c8bfb1aaa9975f8dd37dda718ab7104fbc24f823abd0ad366f4259"} Jun 10 20:11:16.318684 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:16.318629 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-djq44" podStartSLOduration=1.417580159 podStartE2EDuration="7.318613196s" totalImagesPullingTime="5.901033037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:11:16.316489931 +0000 UTC m=+701.337120166" watchObservedRunningTime="2026-06-10 20:11:16.318613196 +0000 UTC m=+701.339243426" Jun 10 20:11:17.193772 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:17.193744 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:24.215883 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:24.215845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:24.316608 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:24.316568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:53.662088 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:53.662053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:53.762427 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:53.762394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:59.505995 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:59.505966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:59.588165 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:59.588136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:11:59.670649 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:11:59.670618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:12:00.028695 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:12:00.028665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:12:03.502267 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:12:03.502153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:12:03.600971 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:12:03.600934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:12:34.535406 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:12:34.535375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:12:34.625920 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:12:34.625886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:12:35.015168 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:12:35.015138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:12:35.147767 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:12:35.147740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:13:25.872848 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:13:25.872812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:13:25.972919 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:13:25.972893 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:13:34.237479 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:13:34.237442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:13:40.950437 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:13:40.950406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:14:01.455178 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:01.455143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:14:13.662921 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:13.662827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:14:22.047305 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:22.047259 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:14:35.428840 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:35.428762 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:14:35.432334 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:35.432309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:14:39.105107 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.105071 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6"] Jun 10 20:14:39.107783 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.107761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.110618 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.110599 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 20:14:39.111575 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.111544 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vb6mh\"" Jun 10 20:14:39.111689 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.111671 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 20:14:39.111758 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.111689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 20:14:39.120091 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.120069 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6"] Jun 10 20:14:39.128170 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.128119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.128170 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.128157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15468e85-d75e-48c7-b2f0-466b347de66b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.128375 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.128235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc87c\" (UniqueName: \"kubernetes.io/projected/15468e85-d75e-48c7-b2f0-466b347de66b-kube-api-access-zc87c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.128375 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.128268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.128375 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.128331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.128598 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.128388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.130743 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.130721 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:14:39.228876 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.228841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229022 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.228901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229022 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.228933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15468e85-d75e-48c7-b2f0-466b347de66b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229022 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.228982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc87c\" (UniqueName: \"kubernetes.io/projected/15468e85-d75e-48c7-b2f0-466b347de66b-kube-api-access-zc87c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229196 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.229098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229260 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.229192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229325 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.229290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229376 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.229327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.229553 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.229504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.231557 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.231535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15468e85-d75e-48c7-b2f0-466b347de66b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.231903 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.231878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15468e85-d75e-48c7-b2f0-466b347de66b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.237183 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.237158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc87c\" (UniqueName: \"kubernetes.io/projected/15468e85-d75e-48c7-b2f0-466b347de66b-kube-api-access-zc87c\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c2gf6\" (UID: \"15468e85-d75e-48c7-b2f0-466b347de66b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.418991 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.418913 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" Jun 10 20:14:39.556086 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:39.556062 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6"] Jun 10 20:14:39.558237 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:14:39.558196 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15468e85_d75e_48c7_b2f0_466b347de66b.slice/crio-72d04a0d0d722767018535a5b76ab32428d0572a6d71142a214eddfa74bf99c8 WatchSource:0}: Error finding container 72d04a0d0d722767018535a5b76ab32428d0572a6d71142a214eddfa74bf99c8: Status 404 returned error can't find the container with id 72d04a0d0d722767018535a5b76ab32428d0572a6d71142a214eddfa74bf99c8 Jun 10 20:14:40.329346 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:40.329314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" event={"ID":"15468e85-d75e-48c7-b2f0-466b347de66b","Type":"ContainerStarted","Data":"72d04a0d0d722767018535a5b76ab32428d0572a6d71142a214eddfa74bf99c8"} Jun 10 20:14:44.354458 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:14:44.354420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c2gf6" event={"ID":"15468e85-d75e-48c7-b2f0-466b347de66b","Type":"ContainerStarted","Data":"8a12358e61f434a682f44ec6b13cd73f25907c17e956abb8ccb3ad133f22b829"} Jun 10 20:16:24.366734 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:16:24.366695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:16:25.437399 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:16:25.437367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:17:01.548198 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:17:01.548162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:17:01.600443 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:17:01.600414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:17:36.068954 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:17:36.068866 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:18:25.329437 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:18:25.329403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:19:35.460431 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:19:35.460345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:19:35.465085 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:19:35.465062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:20:22.643109 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:22.643079 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-c2gf6_15468e85-d75e-48c7-b2f0-466b347de66b/storage-initializer/0.log" Jun 10 20:20:28.111574 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:28.111491 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56984d5999-4gzsj_cbe1a26b-b175-4506-b2d2-7b721233c926/nginx/0.log" Jun 10 20:20:28.388436 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:28.388372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-c6h9d_a238a108-498b-41bc-b603-c0c6c6ca6b3a/manager/0.log" Jun 10 20:20:28.515229 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:28.515183 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8lxhs_fdcb0197-f8c0-4ea9-9691-062d59f9ef8f/manager/0.log" Jun 10 20:20:28.959915 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:28.959888 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-5wmzx_9347022a-3914-477d-bc28-c910caa41f78/server/0.log" Jun 10 20:20:29.079377 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:29.079351 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-h6vvh_fc97fc95-eb20-485f-9114-2b3987e945b8/manager/0.log" Jun 10 20:20:29.360628 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:29.360601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-hr9wz_bc139dff-e96d-49bf-b0ff-d2b3297c79bc/copy-manifests/0.log" Jun 10 20:20:29.368166 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:29.368140 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-hr9wz_bc139dff-e96d-49bf-b0ff-d2b3297c79bc/manager/0.log" Jun 10 20:20:29.611411 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:29.611328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cxdxb_e914c404-14a6-4e75-8aff-2f7879123859/postgres/0.log" Jun 10 20:20:31.981452 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:31.981422 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hcfz7_89059fac-989b-425f-bf46-ea02a02323c7/manager/0.log" Jun 10 20:20:32.090317 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:32.090278 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6mbs5_c9154d88-161e-4a6f-b59b-f071c249785c/manager/0.log" Jun 10 20:20:33.097376 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:33.097335 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fcn65_65b2710d-96bf-42a3-80df-e1cc3f46d68a/discovery/0.log" Jun 10 20:20:33.218397 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:33.218366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d4fd5c67-lkm25_47bb3a99-efc5-4111-af61-ce33a49d4492/kube-auth-proxy/0.log" Jun 10 20:20:33.749639 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:33.749610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bc74b479-6rjqc_6ad4d49a-f4c2-4a5d-a033-4a74b563dd00/router/0.log" Jun 10 20:20:34.658528 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:34.658488 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-c2gf6_15468e85-d75e-48c7-b2f0-466b347de66b/storage-initializer/0.log" Jun 10 20:20:37.051947 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:37.051911 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:20:38.308895 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:38.308860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:20:38.379924 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:38.379884 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" limit=1024 Jun 10 20:20:41.392571 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:41.392537 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l728l_85650ef3-ec00-46ba-9833-2f7e8c26b5c3/global-pull-secret-syncer/0.log" Jun 10 20:20:41.449077 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:41.449048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bxscf_91643a82-0780-4de6-805f-f86134f657a3/konnectivity-agent/0.log" Jun 10 20:20:41.576647 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:41.576619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-104.ec2.internal_775f0be1eafb59e9bc4d24df466e4a75/haproxy/0.log" Jun 10 20:20:45.851313 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:45.851283 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-5pfzw_a3246d56-eeec-4bf6-a39b-7ba30c4f0bc9/sail-operator/0.log" Jun 10 20:20:47.517052 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:47.517024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hcfz7_89059fac-989b-425f-bf46-ea02a02323c7/manager/0.log" Jun 10 20:20:47.558917 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:47.558887 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6mbs5_c9154d88-161e-4a6f-b59b-f071c249785c/manager/0.log" Jun 10 20:20:49.555295 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:49.555267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16596015-12cd-4cf4-91a4-57d2410634a6/alertmanager/0.log" Jun 10 20:20:49.656337 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:49.656309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16596015-12cd-4cf4-91a4-57d2410634a6/config-reloader/0.log" Jun 10 20:20:49.719439 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:49.719414 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16596015-12cd-4cf4-91a4-57d2410634a6/kube-rbac-proxy-web/0.log" Jun 10 20:20:49.788484 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:49.788455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16596015-12cd-4cf4-91a4-57d2410634a6/kube-rbac-proxy/0.log" Jun 10 20:20:49.843314 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:49.843288 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16596015-12cd-4cf4-91a4-57d2410634a6/kube-rbac-proxy-metric/0.log" Jun 10 20:20:49.898505 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:49.898472 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16596015-12cd-4cf4-91a4-57d2410634a6/prom-label-proxy/0.log" Jun 10 20:20:49.952292 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:49.952267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_16596015-12cd-4cf4-91a4-57d2410634a6/init-config-reloader/0.log" Jun 10 20:20:50.011855 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:50.011830 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-m977k_8e998891-ddc5-461c-b095-9f6d037029b9/cluster-monitoring-operator/0.log" Jun 10 20:20:50.537192 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:50.537169 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xlsns_f5eb363d-6da8-4112-a53b-d514f2d45f86/node-exporter/0.log" Jun 10 20:20:50.576603 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:50.576570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xlsns_f5eb363d-6da8-4112-a53b-d514f2d45f86/kube-rbac-proxy/0.log" Jun 10 20:20:50.612421 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:50.612397 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xlsns_f5eb363d-6da8-4112-a53b-d514f2d45f86/init-textfile/0.log" Jun 10 20:20:50.653221 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:50.653196 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qfz57_9a9c4985-74d4-4160-bd41-9785c3bdc1a5/kube-rbac-proxy-main/0.log" Jun 10 20:20:50.685562 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:50.685529 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qfz57_9a9c4985-74d4-4160-bd41-9785c3bdc1a5/kube-rbac-proxy-self/0.log" Jun 10 20:20:50.724581 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:50.724554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qfz57_9a9c4985-74d4-4160-bd41-9785c3bdc1a5/openshift-state-metrics/0.log" Jun 10 20:20:51.199399 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.199372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-m4c97_76a1e49f-7566-43bc-a75c-1a36a5757dee/prometheus-operator-admission-webhook/0.log" Jun 10 20:20:51.755529 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.755478 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm"] Jun 10 20:20:51.759025 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.759009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.762603 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.762583 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpjn6\"/\"kube-root-ca.crt\"" Jun 10 20:20:51.762603 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.762598 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpjn6\"/\"default-dockercfg-x97tc\"" Jun 10 20:20:51.763534 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.763498 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpjn6\"/\"openshift-service-ca.crt\"" Jun 10 20:20:51.797808 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.797781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm"] Jun 10 20:20:51.866790 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.866761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-sys\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.866951 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.866811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-proc\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.866951 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.866829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-lib-modules\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.866951 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.866890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-podres\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.866951 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.866943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ch6\" (UniqueName: \"kubernetes.io/projected/c0832741-0f66-4d56-862e-2d259dfd14ef-kube-api-access-s4ch6\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968302 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-sys\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-proc\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-lib-modules\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-sys\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-podres\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-proc\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-podres\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968483 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0832741-0f66-4d56-862e-2d259dfd14ef-lib-modules\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.968488 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.968488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ch6\" (UniqueName: \"kubernetes.io/projected/c0832741-0f66-4d56-862e-2d259dfd14ef-kube-api-access-s4ch6\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:51.980373 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:51.980353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ch6\" (UniqueName: \"kubernetes.io/projected/c0832741-0f66-4d56-862e-2d259dfd14ef-kube-api-access-s4ch6\") pod \"perf-node-gather-daemonset-rtqkm\" (UID: \"c0832741-0f66-4d56-862e-2d259dfd14ef\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:52.069350 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:52.069270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:52.227733 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:52.227707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm"] Jun 10 20:20:52.228935 ip-10-0-138-104 kubenswrapper[2578]: W0610 20:20:52.228900 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc0832741_0f66_4d56_862e_2d259dfd14ef.slice/crio-4b43a38e1c64c67010bcd458037adaa774b593f6649c02085f6a525caad1052b WatchSource:0}: Error finding container 4b43a38e1c64c67010bcd458037adaa774b593f6649c02085f6a525caad1052b: Status 404 returned error can't find the container with id 4b43a38e1c64c67010bcd458037adaa774b593f6649c02085f6a525caad1052b Jun 10 20:20:52.971545 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:52.971503 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-zm2xf_98a3a1d2-1842-453d-9cfb-b365a65a2468/networking-console-plugin/0.log" Jun 10 20:20:53.205506 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:53.205473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" event={"ID":"c0832741-0f66-4d56-862e-2d259dfd14ef","Type":"ContainerStarted","Data":"b6d57fcf5830f4bf69d49fed2a86417c004ec2084b29e0bd04516fbece365776"} Jun 10 20:20:53.205709 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:53.205601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" event={"ID":"c0832741-0f66-4d56-862e-2d259dfd14ef","Type":"ContainerStarted","Data":"4b43a38e1c64c67010bcd458037adaa774b593f6649c02085f6a525caad1052b"} Jun 10 20:20:53.205709 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:53.205632 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:20:53.225384 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:53.225298 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" podStartSLOduration=2.2252847080000002 podStartE2EDuration="2.225284708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:20:53.224267254 +0000 UTC m=+1278.244897476" watchObservedRunningTime="2026-06-10 20:20:53.225284708 +0000 UTC m=+1278.245914938" Jun 10 20:20:53.515814 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:53.515709 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/1.log" Jun 10 20:20:53.524849 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:53.524798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z4h2m_070cc251-fe8e-4d1b-b27f-d8b96ca2943b/console-operator/2.log" Jun 10 20:20:53.983718 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:53.983691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fc68cff98-4swmc_755a94a8-a6fc-4566-99fc-584f54a4caf8/console/0.log" Jun 10 20:20:54.632997 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:54.632968 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-n6d88_fc17413c-8866-445d-b4d6-8a6192fa596e/volume-data-source-validator/0.log" Jun 10 20:20:55.842603 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:55.842571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdprg_de2132a1-d324-4ec6-b2c3-95851da6e9f2/dns/0.log" Jun 10 20:20:55.867821 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:55.867795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdprg_de2132a1-d324-4ec6-b2c3-95851da6e9f2/kube-rbac-proxy/0.log" Jun 10 20:20:55.950696 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:55.950666 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w7q6n_94f990e9-05a4-48c2-aad9-d0075b23cab3/dns-node-resolver/0.log" Jun 10 20:20:56.541845 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:56.541818 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cvmnq_fe70f0ef-e304-49e3-8be4-b449289a587c/node-ca/0.log" Jun 10 20:20:57.666721 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:57.666691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fcn65_65b2710d-96bf-42a3-80df-e1cc3f46d68a/discovery/0.log" Jun 10 20:20:57.698070 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:57.698043 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d4fd5c67-lkm25_47bb3a99-efc5-4111-af61-ce33a49d4492/kube-auth-proxy/0.log" Jun 10 20:20:57.831224 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:57.831191 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bc74b479-6rjqc_6ad4d49a-f4c2-4a5d-a033-4a74b563dd00/router/0.log" Jun 10 20:20:58.456852 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:58.456818 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-89lsn_f882e4ed-c9aa-440d-87a8-067231d28e9f/serve-healthcheck-canary/0.log" Jun 10 20:20:59.036958 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:59.036899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-wgn6w_3a573eda-5cdd-429d-b055-471a3b333114/insights-operator/0.log" Jun 10 20:20:59.037412 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:59.037381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-wgn6w_3a573eda-5cdd-429d-b055-471a3b333114/insights-operator/1.log" Jun 10 20:20:59.063219 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:59.063193 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44ff4_e11a4a4b-439b-4d27-892f-50dd2106bfa1/kube-rbac-proxy/0.log" Jun 10 20:20:59.086573 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:59.086554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44ff4_e11a4a4b-439b-4d27-892f-50dd2106bfa1/exporter/0.log" Jun 10 20:20:59.112059 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:59.112034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44ff4_e11a4a4b-439b-4d27-892f-50dd2106bfa1/extractor/0.log" Jun 10 20:20:59.220418 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:20:59.220396 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-rtqkm" Jun 10 20:21:01.735077 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:01.735042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56984d5999-4gzsj_cbe1a26b-b175-4506-b2d2-7b721233c926/nginx/0.log" Jun 10 20:21:01.797865 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:01.797837 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-c6h9d_a238a108-498b-41bc-b603-c0c6c6ca6b3a/manager/0.log" Jun 10 20:21:01.844184 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:01.844143 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8lxhs_fdcb0197-f8c0-4ea9-9691-062d59f9ef8f/manager/0.log" Jun 10 20:21:01.972193 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:01.972165 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-5wmzx_9347022a-3914-477d-bc28-c910caa41f78/server/0.log" Jun 10 20:21:02.041579 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:02.041483 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-h6vvh_fc97fc95-eb20-485f-9114-2b3987e945b8/manager/0.log" Jun 10 20:21:02.158309 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:02.158280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-hr9wz_bc139dff-e96d-49bf-b0ff-d2b3297c79bc/manager/0.log" Jun 10 20:21:02.186444 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:02.186415 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-hr9wz_bc139dff-e96d-49bf-b0ff-d2b3297c79bc/copy-manifests/0.log" Jun 10 20:21:02.320582 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:02.320486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cxdxb_e914c404-14a6-4e75-8aff-2f7879123859/postgres/0.log" Jun 10 20:21:06.734930 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:06.734896 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fcn65_65b2710d-96bf-42a3-80df-e1cc3f46d68a/discovery/0.log" Jun 10 20:21:06.746224 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:06.746197 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d4fd5c67-lkm25_47bb3a99-efc5-4111-af61-ce33a49d4492/kube-auth-proxy/0.log" Jun 10 20:21:06.832651 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:06.832625 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bc74b479-6rjqc_6ad4d49a-f4c2-4a5d-a033-4a74b563dd00/router/0.log" Jun 10 20:21:08.043624 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:08.043592 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fcn65_65b2710d-96bf-42a3-80df-e1cc3f46d68a/discovery/0.log" Jun 10 20:21:08.056076 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:08.056055 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55d4fd5c67-lkm25_47bb3a99-efc5-4111-af61-ce33a49d4492/kube-auth-proxy/0.log" Jun 10 20:21:08.145922 ip-10-0-138-104 kubenswrapper[2578]: I0610 20:21:08.145890 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85bc74b479-6rjqc_6ad4d49a-f4c2-4a5d-a033-4a74b563dd00/router/0.log"