Jun 11 21:17:46.385833 ip-10-0-138-17 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 21:17:46.385843 ip-10-0-138-17 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 21:17:46.385850 ip-10-0-138-17 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 21:17:46.386110 ip-10-0-138-17 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 21:17:56.418746 ip-10-0-138-17 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 21:17:56.418761 ip-10-0-138-17 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ef0acd8e2da94d9990b0a58437372364 -- Jun 11 21:20:27.938594 ip-10-0-138-17 systemd[1]: Starting Kubernetes Kubelet... Jun 11 21:20:28.321248 ip-10-0-138-17 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:20:28.321248 ip-10-0-138-17 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 21:20:28.321248 ip-10-0-138-17 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:20:28.321248 ip-10-0-138-17 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 21:20:28.321948 ip-10-0-138-17 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:20:28.322230 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.322140 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 21:20:28.326737 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326717 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.326737 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326736 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.326737 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326741 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326750 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326755 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326759 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326763 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326767 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326770 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326774 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326778 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326782 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326786 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326790 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326794 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326798 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326801 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326807 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326813 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326817 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326821 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.326941 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326827 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326831 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326836 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326840 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326843 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326849 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326853 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326857 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326863 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326871 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326877 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326882 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326887 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326891 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326896 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326905 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326911 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326916 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326921 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.327731 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326925 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326930 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326934 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326938 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326942 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326946 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326951 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326955 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326959 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326963 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326968 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326972 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326976 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326980 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326985 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326991 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326995 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.326999 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327003 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327007 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.328507 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327011 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327015 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327020 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327024 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327029 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327033 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327037 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327042 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327046 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327051 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327056 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327061 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327065 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327069 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327073 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327078 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327082 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327086 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327090 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327094 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.329231 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327099 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327103 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327107 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327111 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327115 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327119 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327123 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327127 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327131 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327136 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327141 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327145 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327149 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327153 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327157 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327161 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327165 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327169 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.327173 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.329967 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.329969 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.329984 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.329990 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.329994 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.329999 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330003 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330008 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330012 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330016 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330020 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330025 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330029 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330033 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330038 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330042 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330049 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330056 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330061 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330066 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.330766 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330070 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330074 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330079 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330083 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330087 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330093 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330098 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330102 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330106 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330110 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330114 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330118 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330132 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330137 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330141 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330147 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330151 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330156 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330160 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330165 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.331612 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330169 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330173 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330177 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330182 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330186 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330190 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330194 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330198 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330202 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330206 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330210 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330214 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330219 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330223 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330227 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330233 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330240 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330246 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330250 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.332503 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330256 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330260 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330265 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330270 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330274 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330296 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330301 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330308 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330314 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330320 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330325 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330329 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330333 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330337 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330341 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330345 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330351 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330355 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330359 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.333249 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330364 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330368 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330372 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330376 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330380 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330384 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330390 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330395 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330399 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330403 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330407 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330411 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330415 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330419 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330423 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330427 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330431 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330435 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330440 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330444 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.333744 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330448 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.330455 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331081 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331090 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331094 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331099 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331103 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331107 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331111 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331116 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331120 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331124 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331128 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331133 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331137 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331141 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331145 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331150 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331155 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331159 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.334350 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331163 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331167 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331171 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331175 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331180 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331186 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331193 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331198 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331203 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331208 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331212 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331217 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331221 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331227 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331232 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331237 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331241 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331246 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331250 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.334947 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331255 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331260 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331264 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331269 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331273 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331297 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331302 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331305 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331309 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331313 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331317 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331321 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331327 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331331 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331335 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331339 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331344 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331349 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331353 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.335588 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331357 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331361 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331367 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331373 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331377 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331382 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331386 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331392 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331396 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331400 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331404 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331408 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331412 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331417 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331421 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331425 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331429 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331434 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331438 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331442 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.336046 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331446 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331452 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331460 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331465 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331469 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331474 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331480 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331484 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331488 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331493 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331496 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331501 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331505 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331509 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331513 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331517 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331521 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331525 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331529 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.336632 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331533 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331538 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331542 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.331546 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331644 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331656 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331666 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331672 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331679 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331683 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331690 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331696 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331701 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331706 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331712 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331717 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331722 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331727 2563 flags.go:64] FLAG: --cgroup-root="" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331731 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331736 2563 flags.go:64] FLAG: --client-ca-file="" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331741 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331747 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331753 2563 flags.go:64] FLAG: --cluster-domain="" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331757 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 21:20:28.337148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331762 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331767 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331772 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331778 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331782 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331787 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331792 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331797 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331802 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331807 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331812 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331817 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331823 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331828 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331833 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331837 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331842 2563 flags.go:64] FLAG: --enable-server="true" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331846 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331853 2563 flags.go:64] FLAG: --event-burst="100" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331858 2563 flags.go:64] FLAG: --event-qps="50" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331863 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331868 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331872 2563 flags.go:64] FLAG: --eviction-hard="" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331878 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 21:20:28.337781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331883 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331887 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331892 2563 flags.go:64] FLAG: --eviction-soft="" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331897 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331902 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331907 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331912 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331916 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331921 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331925 2563 flags.go:64] FLAG: --feature-gates="" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331931 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331936 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331940 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331945 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331951 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331956 2563 flags.go:64] FLAG: --help="false" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331963 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331968 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331973 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331977 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331983 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331988 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331993 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 21:20:28.338444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.331997 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332002 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332006 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332011 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332016 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332020 2563 flags.go:64] FLAG: --kube-reserved="" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332025 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332029 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332034 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332039 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332043 2563 flags.go:64] FLAG: --lock-file="" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332047 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332052 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332057 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332073 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332078 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332083 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332087 2563 flags.go:64] FLAG: --logging-format="text" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332092 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332097 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332102 2563 flags.go:64] FLAG: --manifest-url="" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332106 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332113 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332118 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332125 2563 flags.go:64] FLAG: --max-pods="110" Jun 11 21:20:28.339043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332132 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332137 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332141 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332146 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332151 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332156 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332160 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332171 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332176 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332180 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332185 2563 flags.go:64] FLAG: --pod-cidr="" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332190 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332198 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332203 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332208 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332212 2563 flags.go:64] FLAG: --port="10250" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332217 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332221 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a6d84e8b8c8a3119" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332226 2563 flags.go:64] FLAG: --qos-reserved="" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332231 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332236 2563 flags.go:64] FLAG: --register-node="true" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332240 2563 flags.go:64] FLAG: --register-with-taints="" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332246 2563 flags.go:64] FLAG: --registry-burst="10" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332252 2563 flags.go:64] FLAG: --registry-qps="5" Jun 11 21:20:28.339658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332257 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332261 2563 flags.go:64] FLAG: --reserved-memory="" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332267 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332272 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332296 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332301 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332304 2563 flags.go:64] FLAG: --runonce="false" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332309 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332319 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332324 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332329 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332333 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332338 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332343 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332347 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332352 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332357 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332362 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332366 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332371 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332376 2563 flags.go:64] FLAG: --system-cgroups="" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332380 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332389 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332394 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332398 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 21:20:28.340353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332404 2563 flags.go:64] FLAG: --tls-min-version="" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332410 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332414 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332419 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332424 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332429 2563 flags.go:64] FLAG: --v="2" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332436 2563 flags.go:64] FLAG: --version="false" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332447 2563 flags.go:64] FLAG: --vmodule="" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332452 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.332457 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332645 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332651 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332656 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332660 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332664 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332672 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332677 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332681 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332685 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332689 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332693 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332697 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.340955 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332701 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332706 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332710 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332714 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332719 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332724 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332728 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332732 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332736 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332740 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332744 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332748 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332753 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332757 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332761 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332765 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332769 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332775 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332782 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332787 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.341520 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332792 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332796 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332800 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332805 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332809 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332816 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332821 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332825 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332830 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332834 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332838 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332842 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332846 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332850 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332854 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332859 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332863 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332867 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332871 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332876 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.342003 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332880 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332885 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332888 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332893 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332897 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332903 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332908 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332912 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332916 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332922 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332928 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332932 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332937 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332941 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332945 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332949 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332953 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332960 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332964 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.342523 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332968 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332972 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332979 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332984 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332990 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332994 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.332999 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333004 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333008 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333012 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333016 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333021 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333025 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333029 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333034 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333038 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333042 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333046 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333051 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333055 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.342992 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333059 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333064 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333068 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333072 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333076 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333081 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333085 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.333090 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.333820 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.341607 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.341724 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.341744 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.341749 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341805 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341809 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.343506 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341813 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341816 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341820 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341823 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341826 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341828 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341831 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341834 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341837 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341839 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341842 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341844 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341847 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341850 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341852 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341855 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341857 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341860 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341863 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341865 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.343872 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341868 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341870 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341874 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341877 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341880 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341884 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341887 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341891 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341894 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341897 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341899 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341902 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341905 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341908 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341910 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341922 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341925 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341928 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341931 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341934 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.344369 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341937 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341940 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341944 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341947 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341950 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341953 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341955 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341958 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341960 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341963 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341966 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341968 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341970 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341973 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341977 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341982 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341984 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341987 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341989 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.344847 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341993 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341995 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.341998 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342000 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342003 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342006 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342008 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342011 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342014 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342017 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342019 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342022 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342024 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342027 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342030 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342033 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342035 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342038 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342040 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.345348 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342043 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342045 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342047 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342050 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342052 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342055 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342057 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342061 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342063 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342066 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342069 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342072 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342074 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342077 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342079 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342082 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342084 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342087 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.345812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342089 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.342094 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342217 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342221 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342225 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342229 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342232 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342235 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342238 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342241 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342244 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342247 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342250 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342252 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342255 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:20:28.346253 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342258 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342261 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342263 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342266 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342268 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342271 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342274 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342276 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342295 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342299 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342305 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342309 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342312 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342314 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342317 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342320 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342322 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342325 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342327 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342330 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:20:28.346633 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342333 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342336 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342338 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342341 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342343 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342346 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342348 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342351 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342353 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342356 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342359 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342361 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342364 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342367 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342369 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342372 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342374 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342377 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342379 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342381 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:20:28.347112 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342384 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342386 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342389 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342392 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342395 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342397 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342400 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342402 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342405 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342407 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342410 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342412 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342414 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342417 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342419 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342422 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342424 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342427 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342429 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342431 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:20:28.347607 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342434 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342436 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342439 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342441 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342444 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342446 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342448 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342451 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342453 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342455 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342459 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342462 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342465 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342467 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342470 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342472 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342475 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342479 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342481 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:20:28.348075 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342483 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342486 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342488 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342490 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342493 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342495 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:28.342498 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.342503 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.342607 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.345963 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.347336 2563 server.go:1019] "Starting client certificate rotation" Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.347435 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:20:28.348544 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.347463 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:20:28.350014 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.350000 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:20:28.353091 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.353067 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:20:28.370984 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.370962 2563 log.go:25] "Validated CRI v1 runtime API" Jun 11 21:20:28.375495 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.375476 2563 log.go:25] "Validated CRI v1 image API" Jun 11 21:20:28.376941 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.376918 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 21:20:28.379987 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.379969 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c5423608-b6dc-4c87-ba5a-3d78d0517b02:/dev/nvme0n1p4 c816d511-ac34-4cec-9ed3-0766e2ef0665:/dev/nvme0n1p3] Jun 11 21:20:28.380046 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.379989 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 21:20:28.382312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.382292 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:20:28.386067 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.385962 2563 manager.go:216] Machine: {Timestamp:2026-06-11 21:20:28.383636505 +0000 UTC m=+0.328173898 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098355 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec205eec082852c3efdbe619acc430e3 SystemUUID:ec205eec-0828-52c3-efdb-e619acc430e3 BootID:ef0acd8e-2da9-4d99-90b0-a58437372364 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:0f:ab:06:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:0f:ab:06:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:37:52:97:97:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 21:20:28.386067 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.386066 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 21:20:28.386195 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.386183 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 21:20:28.389459 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.389430 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 21:20:28.389607 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.389462 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 21:20:28.390953 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.390942 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 21:20:28.390986 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.390955 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 21:20:28.390986 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.390963 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:20:28.391829 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.391819 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:20:28.393657 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.393647 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 21:20:28.397250 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397238 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:20:28.397402 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397392 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 21:20:28.397433 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397430 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 11 21:20:28.397465 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397444 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 21:20:28.397465 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397458 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 21:20:28.397515 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397467 2563 kubelet.go:398] "Adding apiserver pod source" Jun 11 21:20:28.397515 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397476 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 21:20:28.397840 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397829 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:20:28.397883 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.397848 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:20:28.399973 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.399952 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 21:20:28.402443 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.402428 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 21:20:28.402512 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.402460 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 21:20:28.403653 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403642 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 21:20:28.403697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403658 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 21:20:28.403697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403669 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 21:20:28.403697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403675 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 21:20:28.403697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403683 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 21:20:28.403697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403688 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 21:20:28.403697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403696 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 21:20:28.403843 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403701 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 21:20:28.403843 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403707 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 21:20:28.403843 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403713 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 21:20:28.403843 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403721 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 21:20:28.403843 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.403726 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 21:20:28.404478 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.404469 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 21:20:28.404478 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.404479 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 21:20:28.405511 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.405492 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhcx9" Jun 11 21:20:28.407159 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.407128 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 21:20:28.410140 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.407142 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 21:20:28.410140 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.408541 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 21:20:28.410563 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.410550 2563 server.go:1268] "Started kubelet" Jun 11 21:20:28.410658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.410638 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 21:20:28.410726 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.410678 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 21:20:28.410773 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.410749 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 21:20:28.411591 ip-10-0-138-17 systemd[1]: Started Kubernetes Kubelet. Jun 11 21:20:28.412591 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.412581 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 11 21:20:28.416031 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.416005 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 21:20:28.416124 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.416096 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhcx9" Jun 11 21:20:28.418753 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.418721 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 21:20:28.419766 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.417952 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-17.ec2.internal.18b823a152c723e4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-17.ec2.internal,UID:ip-10-0-138-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-17.ec2.internal,},FirstTimestamp:2026-06-11 21:20:28.410520548 +0000 UTC m=+0.355057920,LastTimestamp:2026-06-11 21:20:28.410520548 +0000 UTC m=+0.355057920,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-17.ec2.internal,}" Jun 11 21:20:28.423382 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.423360 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 21:20:28.423382 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.423373 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 21:20:28.423628 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.423615 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:28.424241 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424206 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 21:20:28.424451 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424422 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 21:20:28.424451 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424443 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 21:20:28.424720 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424688 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 21:20:28.424720 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424705 2563 factory.go:55] Registering systemd factory Jun 11 21:20:28.424720 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424714 2563 factory.go:223] Registration of the systemd container factory successfully Jun 11 21:20:28.424857 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424736 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 11 21:20:28.424857 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424743 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 11 21:20:28.424984 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424970 2563 factory.go:153] Registering CRI-O factory Jun 11 21:20:28.425020 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.424989 2563 factory.go:223] Registration of the crio container factory successfully Jun 11 21:20:28.425020 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.425012 2563 factory.go:103] Registering Raw factory Jun 11 21:20:28.425083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.425025 2563 manager.go:1196] Started watching for new ooms in manager Jun 11 21:20:28.425469 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.425453 2563 manager.go:349] Starting recovery of all containers Jun 11 21:20:28.425541 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.425510 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:28.427847 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.427830 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-17.ec2.internal\" not found" node="ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.435109 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.435095 2563 manager.go:354] Recovery completed Jun 11 21:20:28.438994 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.438981 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.440812 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.440798 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.440858 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.440826 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.440858 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.440836 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.441336 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.441323 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 21:20:28.441336 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.441334 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 21:20:28.441467 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.441337 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.441467 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.441350 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:20:28.442000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.441986 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.442062 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.442011 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.442062 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.442036 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.442416 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.442406 2563 policy_none.go:49] "None policy: Start" Jun 11 21:20:28.442462 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.442421 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 21:20:28.442462 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.442431 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 21:20:28.443326 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.443316 2563 policy_none.go:47] "Start" Jun 11 21:20:28.484918 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.484901 2563 manager.go:337] "Starting Device Plugin manager" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.484982 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.484995 2563 server.go:87] "Starting device plugin registration server" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.485258 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.485270 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.485383 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.485524 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.485535 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.486446 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.486493 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.492721 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.494092 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.494135 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.494158 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 21:20:28.494860 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.494234 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 21:20:28.496121 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.496074 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:28.585659 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.585584 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.587437 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.587420 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.587524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.587451 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.587524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.587466 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.587524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.587494 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.594472 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.594455 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal"] Jun 11 21:20:28.594528 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.594513 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.595259 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.595244 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.595352 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.595274 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.595352 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.595309 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.595904 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.595890 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.595939 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.595914 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-17.ec2.internal\": node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:28.596687 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.596675 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.596810 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.596787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.596850 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.596822 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.598127 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.598102 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.598127 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.598121 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.598275 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.598137 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.598275 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.598150 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.598275 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.598161 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.598275 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.598176 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.599781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.599767 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.599851 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.599792 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:20:28.600448 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.600428 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:20:28.600500 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.600453 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:20:28.600500 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.600462 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:20:28.610057 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.610042 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:28.625646 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.625619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/140b291ced525d73266b7ccd886aa844-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"140b291ced525d73266b7ccd886aa844\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.625708 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.625651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140b291ced525d73266b7ccd886aa844-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"140b291ced525d73266b7ccd886aa844\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.625708 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.625671 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84b106941e4bd3acb99330a3abc18a7d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"84b106941e4bd3acb99330a3abc18a7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.630875 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.630858 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-17.ec2.internal\" not found" node="ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.635183 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.635169 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-17.ec2.internal\" not found" node="ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.710261 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.710241 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:28.725973 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.725951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/140b291ced525d73266b7ccd886aa844-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"140b291ced525d73266b7ccd886aa844\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.726063 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.725984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140b291ced525d73266b7ccd886aa844-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"140b291ced525d73266b7ccd886aa844\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.726063 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.726008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84b106941e4bd3acb99330a3abc18a7d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"84b106941e4bd3acb99330a3abc18a7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.726148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.726057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/140b291ced525d73266b7ccd886aa844-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"140b291ced525d73266b7ccd886aa844\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.726148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.726056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84b106941e4bd3acb99330a3abc18a7d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-17.ec2.internal\" (UID: \"84b106941e4bd3acb99330a3abc18a7d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.726148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.726059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140b291ced525d73266b7ccd886aa844-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal\" (UID: \"140b291ced525d73266b7ccd886aa844\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.810865 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.810837 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:28.911626 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:28.911549 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:28.933948 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.933926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:28.938965 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:28.938947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" Jun 11 21:20:29.011668 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:29.011640 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:29.112081 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:29.112049 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:29.212641 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:29.212576 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:29.313201 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:29.313170 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:29.346669 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.346641 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 21:20:29.347233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.346804 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:20:29.347233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.346814 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:20:29.414136 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:29.413998 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:29.421994 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.421967 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:15:28 +0000 UTC" deadline="2027-11-24 18:05:01.697962809 +0000 UTC" Jun 11 21:20:29.422086 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.421995 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12740h44m32.275972695s" Jun 11 21:20:29.460389 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:29.460355 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b106941e4bd3acb99330a3abc18a7d.slice/crio-7414797791a950b76ab8dfcac1e9e29c7d3f156b3fed39cf974417ddf92983ad WatchSource:0}: Error finding container 7414797791a950b76ab8dfcac1e9e29c7d3f156b3fed39cf974417ddf92983ad: Status 404 returned error can't find the container with id 7414797791a950b76ab8dfcac1e9e29c7d3f156b3fed39cf974417ddf92983ad Jun 11 21:20:29.460979 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:29.460959 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140b291ced525d73266b7ccd886aa844.slice/crio-5e64ccfef6eecc2913b36b2d847198fdd9039d6526bcd8791724100aceb85627 WatchSource:0}: Error finding container 5e64ccfef6eecc2913b36b2d847198fdd9039d6526bcd8791724100aceb85627: Status 404 returned error can't find the container with id 5e64ccfef6eecc2913b36b2d847198fdd9039d6526bcd8791724100aceb85627 Jun 11 21:20:29.466578 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.466562 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:20:29.497481 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.497437 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" event={"ID":"84b106941e4bd3acb99330a3abc18a7d","Type":"ContainerStarted","Data":"7414797791a950b76ab8dfcac1e9e29c7d3f156b3fed39cf974417ddf92983ad"} Jun 11 21:20:29.498363 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.498331 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"140b291ced525d73266b7ccd886aa844","Type":"ContainerStarted","Data":"5e64ccfef6eecc2913b36b2d847198fdd9039d6526bcd8791724100aceb85627"} Jun 11 21:20:29.514510 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:29.514489 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-17.ec2.internal\" not found" Jun 11 21:20:29.525825 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.525803 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:29.624903 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.624882 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" Jun 11 21:20:29.634794 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.634777 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:20:29.636697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.636685 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" Jun 11 21:20:29.643654 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:29.643641 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:20:30.012809 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.012774 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:30.155637 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.155601 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:30.398438 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.398350 2563 apiserver.go:52] "Watching apiserver" Jun 11 21:20:30.409677 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.409644 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 21:20:30.410629 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.410599 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hsh8x","openshift-multus/network-metrics-daemon-pzdps","openshift-network-diagnostics/network-check-target-9nqlp","openshift-network-operator/iptables-alerter-4vm68","openshift-ovn-kubernetes/ovnkube-node-8jttt","kube-system/global-pull-secret-syncer-2ndxt","kube-system/konnectivity-agent-mpg6h","kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal","openshift-cluster-node-tuning-operator/tuned-f4xqc","openshift-dns/node-resolver-zkbvv","openshift-image-registry/node-ca-c6q2b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal","openshift-multus/multus-additional-cni-plugins-292vv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss"] Jun 11 21:20:30.412884 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.412744 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.413923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.413892 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.415664 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.415032 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:30.415664 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.415100 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:30.415664 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.415425 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k4cdp\"" Jun 11 21:20:30.415664 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.415479 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 21:20:30.415664 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.415430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 21:20:30.416215 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.416193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.416431 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.416405 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 21:20:30.416633 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.416617 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 21:20:30.416690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.416632 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.416690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.416655 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cxtdw\"" Jun 11 21:20:30.416690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.416668 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.416798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.416622 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 21:20:30.418216 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.418198 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.418906 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.418887 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4n4vq\"" Jun 11 21:20:30.418999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.418987 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.419060 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.419000 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.419060 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.418993 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 21:20:30.419785 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.419767 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.419865 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.419844 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:30.420089 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.420071 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 21:20:30.420411 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.420395 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 21:20:30.421305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.420733 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w7xwg\"" Jun 11 21:20:30.421305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.420933 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 21:20:30.421305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.420952 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.421305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.421141 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.421305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.421160 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 21:20:30.421864 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.421429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.422830 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.422810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.423255 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.423236 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.423665 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.423649 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.423740 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.423653 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q4zb7\"" Jun 11 21:20:30.423997 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.423980 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:30.424071 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.424042 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:30.424253 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.424234 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 21:20:30.424725 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.424706 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 21:20:30.424993 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.424977 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5schf\"" Jun 11 21:20:30.425317 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.425301 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.427618 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.427588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.428157 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.428130 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.428301 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.428198 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mcrl4\"" Jun 11 21:20:30.428301 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.428201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.429095 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.429079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.429838 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.429818 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.429986 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.429828 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 21:20:30.430044 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.429971 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.430783 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.430765 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2rrjr\"" Jun 11 21:20:30.431688 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.431668 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 21:20:30.432114 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.432095 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5qbn8\"" Jun 11 21:20:30.432219 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.432202 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 21:20:30.433044 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.433028 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 21:20:30.434774 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7s8\" (UniqueName: \"kubernetes.io/projected/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-kube-api-access-5v7s8\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:30.434863 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-etc-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.434863 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-ovn\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.434863 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-etc-kubernetes\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.435019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-systemd\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.435019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-hostroot\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.435019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d7a371e-2869-4317-8eb4-fa094127573b-multus-daemon-config\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.435019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c03ec144-49ce-48a3-b6ab-2644e556a7e3-hosts-file\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.435019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.434999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/efe493e9-bfb7-4cc8-bf80-51daba89e0c4-agent-certs\") pod \"konnectivity-agent-mpg6h\" (UID: \"efe493e9-bfb7-4cc8-bf80-51daba89e0c4\") " pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.435019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.435303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-kubelet\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.435303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-slash\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.435303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d7a371e-2869-4317-8eb4-fa094127573b-cni-binary-copy\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.435303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91216e2c-1808-42a0-ba32-2758680cf590-iptables-alerter-script\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.435303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-kubernetes\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.435303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-cni-bin\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.435885 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovn-node-metrics-cert\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.435974 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.435939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-os-release\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.436032 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91216e2c-1808-42a0-ba32-2758680cf590-host-slash\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.436106 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4n4f\" (UniqueName: \"kubernetes.io/projected/53ded20b-ac9c-4623-909d-27aaa08e76fd-kube-api-access-t4n4f\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.436191 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-multus-certs\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.436249 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/efe493e9-bfb7-4cc8-bf80-51daba89e0c4-konnectivity-ca\") pod \"konnectivity-agent-mpg6h\" (UID: \"efe493e9-bfb7-4cc8-bf80-51daba89e0c4\") " pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.436316 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysconfig\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.436316 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66f0380c-2550-4899-a72c-79bb54cea20f-tmp\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.436417 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436326 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca6dd972-369c-4017-9d02-85b937fdaa45-dbus\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.436417 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmk4r\" (UniqueName: \"kubernetes.io/projected/6d7a371e-2869-4317-8eb4-fa094127573b-kube-api-access-lmk4r\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.436417 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:30.436550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-cni-multus\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.436550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-conf-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.436550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-cnibin\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.436736 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-lib-modules\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.436736 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436604 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:20:30.436736 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-node-log\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.436736 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-cni-netd\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.436736 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovnkube-config\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.436736 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-env-overrides\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.436982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-cni-bin\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.436982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-kubelet\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.436982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-cni-binary-copy\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.436982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9dgv\" (UniqueName: \"kubernetes.io/projected/05c02e3d-d937-4ff3-9010-99701fc57d85-kube-api-access-v9dgv\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.436982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-var-lib-kubelet\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.436982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovnkube-script-lib\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.436982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.436974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-netns\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysctl-d\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-system-cni-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-host\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9w5x\" (UniqueName: \"kubernetes.io/projected/66f0380c-2550-4899-a72c-79bb54cea20f-kube-api-access-f9w5x\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-cni-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03ec144-49ce-48a3-b6ab-2644e556a7e3-tmp-dir\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-system-cni-dir\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-modprobe-d\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-log-socket\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.437333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-cnibin\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-socket-dir-parent\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7qzm\" (UniqueName: \"kubernetes.io/projected/91216e2c-1808-42a0-ba32-2758680cf590-kube-api-access-w7qzm\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-var-lib-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca6dd972-369c-4017-9d02-85b937fdaa45-kubelet-config\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-os-release\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-sys\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-systemd-units\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-run-netns\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysctl-conf\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-run\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.437837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66f0380c-2550-4899-a72c-79bb54cea20f-etc-tuned\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.438752 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-k8s-cni-cncf-io\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.438752 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp5s7\" (UniqueName: \"kubernetes.io/projected/c03ec144-49ce-48a3-b6ab-2644e556a7e3-kube-api-access-hp5s7\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.438752 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.437876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-systemd\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.457416 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.457388 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bgkxj" Jun 11 21:20:30.464224 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.464199 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bgkxj" Jun 11 21:20:30.523457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.523422 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:20:30.525200 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.525181 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 21:20:30.538506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.538631 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:30.538631 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-run\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.538631 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66f0380c-2550-4899-a72c-79bb54cea20f-etc-tuned\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.538631 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67719a28-cefc-469d-8582-fde072f45b8c-host\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.538631 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-k8s-cni-cncf-io\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.538631 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.538623 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538670 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-k8s-cni-cncf-io\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.538691 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret podName:ca6dd972-369c-4017-9d02-85b937fdaa45 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:31.038669147 +0000 UTC m=+2.983206520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret") pod "global-pull-secret-syncer-2ndxt" (UID: "ca6dd972-369c-4017-9d02-85b937fdaa45") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-run\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp5s7\" (UniqueName: \"kubernetes.io/projected/c03ec144-49ce-48a3-b6ab-2644e556a7e3-kube-api-access-hp5s7\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-systemd\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7s8\" (UniqueName: \"kubernetes.io/projected/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-kube-api-access-5v7s8\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-etc-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538880 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-systemd\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-ovn\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-ovn\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.538923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-etc-kubernetes\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-etc-kubernetes\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-systemd\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-etc-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538955 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-systemd\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.538980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-hostroot\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-hostroot\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d7a371e-2869-4317-8eb4-fa094127573b-multus-daemon-config\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c03ec144-49ce-48a3-b6ab-2644e556a7e3-hosts-file\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/efe493e9-bfb7-4cc8-bf80-51daba89e0c4-agent-certs\") pod \"konnectivity-agent-mpg6h\" (UID: \"efe493e9-bfb7-4cc8-bf80-51daba89e0c4\") " pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-socket-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-sys-fs\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539198 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c03ec144-49ce-48a3-b6ab-2644e556a7e3-hosts-file\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-kubelet\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-slash\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d7a371e-2869-4317-8eb4-fa094127573b-cni-binary-copy\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.539394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91216e2c-1808-42a0-ba32-2758680cf590-iptables-alerter-script\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-kubernetes\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-cni-bin\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovn-node-metrics-cert\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-kubelet\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-os-release\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91216e2c-1808-42a0-ba32-2758680cf590-host-slash\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4n4f\" (UniqueName: \"kubernetes.io/projected/53ded20b-ac9c-4623-909d-27aaa08e76fd-kube-api-access-t4n4f\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539486 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqwcg\" (UniqueName: \"kubernetes.io/projected/67719a28-cefc-469d-8582-fde072f45b8c-kube-api-access-qqwcg\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-multus-certs\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539552 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d7a371e-2869-4317-8eb4-fa094127573b-multus-daemon-config\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/efe493e9-bfb7-4cc8-bf80-51daba89e0c4-konnectivity-ca\") pod \"konnectivity-agent-mpg6h\" (UID: \"efe493e9-bfb7-4cc8-bf80-51daba89e0c4\") " pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539610 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91216e2c-1808-42a0-ba32-2758680cf590-host-slash\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysconfig\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66f0380c-2550-4899-a72c-79bb54cea20f-tmp\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca6dd972-369c-4017-9d02-85b937fdaa45-dbus\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.540312 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539716 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67719a28-cefc-469d-8582-fde072f45b8c-serviceca\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmk4r\" (UniqueName: \"kubernetes.io/projected/6d7a371e-2869-4317-8eb4-fa094127573b-kube-api-access-lmk4r\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539767 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-cni-multus\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-conf-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-cnibin\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-lib-modules\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-node-log\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-cni-netd\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovnkube-config\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91216e2c-1808-42a0-ba32-2758680cf590-iptables-alerter-script\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-env-overrides\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d7a371e-2869-4317-8eb4-fa094127573b-cni-binary-copy\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/efe493e9-bfb7-4cc8-bf80-51daba89e0c4-konnectivity-ca\") pod \"konnectivity-agent-mpg6h\" (UID: \"efe493e9-bfb7-4cc8-bf80-51daba89e0c4\") " pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.539439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-kubernetes\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-cnibin\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-slash\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-cni-bin\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541006 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.540199 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.540304 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:31.04024661 +0000 UTC m=+2.984783969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540354 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-cni-multus\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540367 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-multus-certs\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-conf-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-env-overrides\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca6dd972-369c-4017-9d02-85b937fdaa45-dbus\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-cni-netd\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-node-log\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-lib-modules\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-cni-bin\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-kubelet\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-cni-binary-copy\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9dgv\" (UniqueName: \"kubernetes.io/projected/05c02e3d-d937-4ff3-9010-99701fc57d85-kube-api-access-v9dgv\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-var-lib-kubelet\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovnkube-script-lib\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-netns\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.541874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysctl-d\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-system-cni-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-host\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-device-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9w5x\" (UniqueName: \"kubernetes.io/projected/66f0380c-2550-4899-a72c-79bb54cea20f-kube-api-access-f9w5x\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-cni-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.540979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03ec144-49ce-48a3-b6ab-2644e556a7e3-tmp-dir\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-system-cni-dir\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovnkube-config\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-modprobe-d\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-log-socket\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541069 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkn2r\" (UniqueName: \"kubernetes.io/projected/8032af66-0801-46d7-a634-33e8c61792b0-kube-api-access-kkn2r\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-cni-bin\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.542622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-cnibin\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-socket-dir-parent\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-cnibin\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7qzm\" (UniqueName: \"kubernetes.io/projected/91216e2c-1808-42a0-ba32-2758680cf590-kube-api-access-w7qzm\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-var-lib-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-system-cni-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca6dd972-369c-4017-9d02-85b937fdaa45-kubelet-config\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-os-release\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-sys\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-systemd-units\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-run-netns\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-registration-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysctl-conf\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.543404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysctl-conf\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541691 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-var-lib-kubelet\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541719 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.541785 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-host\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542050 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-cni-dir\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-cni-binary-copy\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03ec144-49ce-48a3-b6ab-2644e556a7e3-tmp-dir\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-system-cni-dir\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542550 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-modprobe-d\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542589 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-log-socket\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-var-lib-kubelet\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05c02e3d-d937-4ff3-9010-99701fc57d85-os-release\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-host-run-netns\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysctl-d\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.542836 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-multus-socket-dir-parent\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-var-lib-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovn-node-metrics-cert\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543091 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53ded20b-ac9c-4623-909d-27aaa08e76fd-ovnkube-script-lib\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca6dd972-369c-4017-9d02-85b937fdaa45-kubelet-config\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/efe493e9-bfb7-4cc8-bf80-51daba89e0c4-agent-certs\") pod \"konnectivity-agent-mpg6h\" (UID: \"efe493e9-bfb7-4cc8-bf80-51daba89e0c4\") " pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d7a371e-2869-4317-8eb4-fa094127573b-os-release\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-sys\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/66f0380c-2550-4899-a72c-79bb54cea20f-etc-sysconfig\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-run-openvswitch\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-host-run-netns\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543255 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53ded20b-ac9c-4623-909d-27aaa08e76fd-systemd-units\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05c02e3d-d937-4ff3-9010-99701fc57d85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/66f0380c-2550-4899-a72c-79bb54cea20f-etc-tuned\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.544800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.543996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66f0380c-2550-4899-a72c-79bb54cea20f-tmp\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.548391 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.548373 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:30.548391 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.548390 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:30.548564 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.548410 2563 projected.go:196] Error preparing data for projected volume kube-api-access-b72jz for pod openshift-network-diagnostics/network-check-target-9nqlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:30.548564 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:30.548474 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz podName:c8f436d5-cebc-4b43-b8bc-056b9e18c947 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:31.048453724 +0000 UTC m=+2.992991118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b72jz" (UniqueName: "kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz") pod "network-check-target-9nqlp" (UID: "c8f436d5-cebc-4b43-b8bc-056b9e18c947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:30.553409 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.553375 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9w5x\" (UniqueName: \"kubernetes.io/projected/66f0380c-2550-4899-a72c-79bb54cea20f-kube-api-access-f9w5x\") pod \"tuned-f4xqc\" (UID: \"66f0380c-2550-4899-a72c-79bb54cea20f\") " pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.553798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.553752 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7qzm\" (UniqueName: \"kubernetes.io/projected/91216e2c-1808-42a0-ba32-2758680cf590-kube-api-access-w7qzm\") pod \"iptables-alerter-4vm68\" (UID: \"91216e2c-1808-42a0-ba32-2758680cf590\") " pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.555496 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.555445 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp5s7\" (UniqueName: \"kubernetes.io/projected/c03ec144-49ce-48a3-b6ab-2644e556a7e3-kube-api-access-hp5s7\") pod \"node-resolver-zkbvv\" (UID: \"c03ec144-49ce-48a3-b6ab-2644e556a7e3\") " pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.556444 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.556418 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4n4f\" (UniqueName: \"kubernetes.io/projected/53ded20b-ac9c-4623-909d-27aaa08e76fd-kube-api-access-t4n4f\") pod \"ovnkube-node-8jttt\" (UID: \"53ded20b-ac9c-4623-909d-27aaa08e76fd\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.557638 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.557616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7s8\" (UniqueName: \"kubernetes.io/projected/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-kube-api-access-5v7s8\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:30.557872 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.557852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmk4r\" (UniqueName: \"kubernetes.io/projected/6d7a371e-2869-4317-8eb4-fa094127573b-kube-api-access-lmk4r\") pod \"multus-hsh8x\" (UID: \"6d7a371e-2869-4317-8eb4-fa094127573b\") " pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.558233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.558211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9dgv\" (UniqueName: \"kubernetes.io/projected/05c02e3d-d937-4ff3-9010-99701fc57d85-kube-api-access-v9dgv\") pod \"multus-additional-cni-plugins-292vv\" (UID: \"05c02e3d-d937-4ff3-9010-99701fc57d85\") " pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.642585 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkn2r\" (UniqueName: \"kubernetes.io/projected/8032af66-0801-46d7-a634-33e8c61792b0-kube-api-access-kkn2r\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642741 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-registration-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642741 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642741 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67719a28-cefc-469d-8582-fde072f45b8c-host\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.642741 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-socket-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642741 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-registration-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-sys-fs\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67719a28-cefc-469d-8582-fde072f45b8c-host\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642796 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-socket-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642810 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-sys-fs\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqwcg\" (UniqueName: \"kubernetes.io/projected/67719a28-cefc-469d-8582-fde072f45b8c-kube-api-access-qqwcg\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67719a28-cefc-469d-8582-fde072f45b8c-serviceca\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-device-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.642971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.643322 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.642981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8032af66-0801-46d7-a634-33e8c61792b0-device-dir\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.643322 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.643224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67719a28-cefc-469d-8582-fde072f45b8c-serviceca\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.651275 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.651188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqwcg\" (UniqueName: \"kubernetes.io/projected/67719a28-cefc-469d-8582-fde072f45b8c-kube-api-access-qqwcg\") pod \"node-ca-c6q2b\" (UID: \"67719a28-cefc-469d-8582-fde072f45b8c\") " pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.651400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.651323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkn2r\" (UniqueName: \"kubernetes.io/projected/8032af66-0801-46d7-a634-33e8c61792b0-kube-api-access-kkn2r\") pod \"aws-ebs-csi-driver-node-rqxss\" (UID: \"8032af66-0801-46d7-a634-33e8c61792b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:30.725363 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.725324 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:30.732885 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.732858 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-292vv" Jun 11 21:20:30.745829 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.745805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vm68" Jun 11 21:20:30.751135 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.751112 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:30.757887 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.757864 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" Jun 11 21:20:30.764665 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.764630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hsh8x" Jun 11 21:20:30.773321 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.773297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zkbvv" Jun 11 21:20:30.780990 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.780966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6q2b" Jun 11 21:20:30.786890 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:30.786871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" Jun 11 21:20:31.046431 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.046354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:31.046431 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.046424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:31.046651 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.046497 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:31.046651 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.046543 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:31.046651 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.046586 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:32.046553641 +0000 UTC m=+3.991091015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:31.046651 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.046620 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret podName:ca6dd972-369c-4017-9d02-85b937fdaa45 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:32.046611002 +0000 UTC m=+3.991148365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret") pod "global-pull-secret-syncer-2ndxt" (UID: "ca6dd972-369c-4017-9d02-85b937fdaa45") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:31.147129 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.147098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:31.147347 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.147247 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:31.147347 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.147268 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:31.147347 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.147277 2563 projected.go:196] Error preparing data for projected volume kube-api-access-b72jz for pod openshift-network-diagnostics/network-check-target-9nqlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:31.147517 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:31.147353 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz podName:c8f436d5-cebc-4b43-b8bc-056b9e18c947 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:32.147332225 +0000 UTC m=+4.091869592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72jz" (UniqueName: "kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz") pod "network-check-target-9nqlp" (UID: "c8f436d5-cebc-4b43-b8bc-056b9e18c947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:31.328762 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.328731 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8032af66_0801_46d7_a634_33e8c61792b0.slice/crio-9d58e9c0df506a4b5d818ae69612fff3751de3f7b0573a4643c23d905d8ffaab WatchSource:0}: Error finding container 9d58e9c0df506a4b5d818ae69612fff3751de3f7b0573a4643c23d905d8ffaab: Status 404 returned error can't find the container with id 9d58e9c0df506a4b5d818ae69612fff3751de3f7b0573a4643c23d905d8ffaab Jun 11 21:20:31.329440 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.329407 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7a371e_2869_4317_8eb4_fa094127573b.slice/crio-a33b90ce5ab67da3c84a0ff4ab0a2828a49e851cdc3403e0c5338079d8a6711b WatchSource:0}: Error finding container a33b90ce5ab67da3c84a0ff4ab0a2828a49e851cdc3403e0c5338079d8a6711b: Status 404 returned error can't find the container with id a33b90ce5ab67da3c84a0ff4ab0a2828a49e851cdc3403e0c5338079d8a6711b Jun 11 21:20:31.330563 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.330528 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91216e2c_1808_42a0_ba32_2758680cf590.slice/crio-cbbcf1416147cf62e24d5d4480f67e3afb0a0316bccd4ae4888d48205c57f049 WatchSource:0}: Error finding container cbbcf1416147cf62e24d5d4480f67e3afb0a0316bccd4ae4888d48205c57f049: Status 404 returned error can't find the container with id cbbcf1416147cf62e24d5d4480f67e3afb0a0316bccd4ae4888d48205c57f049 Jun 11 21:20:31.334812 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.334793 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe493e9_bfb7_4cc8_bf80_51daba89e0c4.slice/crio-f22e54a629c66976b281048ce742e3c7d6b8ebfb83a4afcfdb13e4d98fae26bc WatchSource:0}: Error finding container f22e54a629c66976b281048ce742e3c7d6b8ebfb83a4afcfdb13e4d98fae26bc: Status 404 returned error can't find the container with id f22e54a629c66976b281048ce742e3c7d6b8ebfb83a4afcfdb13e4d98fae26bc Jun 11 21:20:31.336393 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.336378 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67719a28_cefc_469d_8582_fde072f45b8c.slice/crio-9d81764310f78e877e620f25db9be9163e9d833839dd392664a8599261ea0d53 WatchSource:0}: Error finding container 9d81764310f78e877e620f25db9be9163e9d833839dd392664a8599261ea0d53: Status 404 returned error can't find the container with id 9d81764310f78e877e620f25db9be9163e9d833839dd392664a8599261ea0d53 Jun 11 21:20:31.338230 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.338210 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ded20b_ac9c_4623_909d_27aaa08e76fd.slice/crio-a6f492b5a06360af4848469bed8eac5fbca10897d50e3e27faac40d53f7df6e7 WatchSource:0}: Error finding container a6f492b5a06360af4848469bed8eac5fbca10897d50e3e27faac40d53f7df6e7: Status 404 returned error can't find the container with id a6f492b5a06360af4848469bed8eac5fbca10897d50e3e27faac40d53f7df6e7 Jun 11 21:20:31.338725 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.338706 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c02e3d_d937_4ff3_9010_99701fc57d85.slice/crio-1f70ed6c1cb42997ac0464816184700dba7a96dd8ee1ae37c318d242dc5563ce WatchSource:0}: Error finding container 1f70ed6c1cb42997ac0464816184700dba7a96dd8ee1ae37c318d242dc5563ce: Status 404 returned error can't find the container with id 1f70ed6c1cb42997ac0464816184700dba7a96dd8ee1ae37c318d242dc5563ce Jun 11 21:20:31.340971 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.340942 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03ec144_49ce_48a3_b6ab_2644e556a7e3.slice/crio-e3b81766b59b8a339f8ab7846bfbd53fce329aefd381b5d92109de05fccb2065 WatchSource:0}: Error finding container e3b81766b59b8a339f8ab7846bfbd53fce329aefd381b5d92109de05fccb2065: Status 404 returned error can't find the container with id e3b81766b59b8a339f8ab7846bfbd53fce329aefd381b5d92109de05fccb2065 Jun 11 21:20:31.341958 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:20:31.341936 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f0380c_2550_4899_a72c_79bb54cea20f.slice/crio-6e5ac30391746e68267543db6e3ec512c09523219d7d0897d9b7d413bfefe466 WatchSource:0}: Error finding container 6e5ac30391746e68267543db6e3ec512c09523219d7d0897d9b7d413bfefe466: Status 404 returned error can't find the container with id 6e5ac30391746e68267543db6e3ec512c09523219d7d0897d9b7d413bfefe466 Jun 11 21:20:31.466589 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.466554 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:15:30 +0000 UTC" deadline="2028-03-05 10:45:17.745206462 +0000 UTC" Jun 11 21:20:31.466961 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.466593 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15181h24m46.278624524s" Jun 11 21:20:31.502603 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.502565 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6q2b" event={"ID":"67719a28-cefc-469d-8582-fde072f45b8c","Type":"ContainerStarted","Data":"9d81764310f78e877e620f25db9be9163e9d833839dd392664a8599261ea0d53"} Jun 11 21:20:31.503871 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.503846 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" event={"ID":"66f0380c-2550-4899-a72c-79bb54cea20f","Type":"ContainerStarted","Data":"6e5ac30391746e68267543db6e3ec512c09523219d7d0897d9b7d413bfefe466"} Jun 11 21:20:31.505115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.505090 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"a6f492b5a06360af4848469bed8eac5fbca10897d50e3e27faac40d53f7df6e7"} Jun 11 21:20:31.506219 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.506197 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mpg6h" event={"ID":"efe493e9-bfb7-4cc8-bf80-51daba89e0c4","Type":"ContainerStarted","Data":"f22e54a629c66976b281048ce742e3c7d6b8ebfb83a4afcfdb13e4d98fae26bc"} Jun 11 21:20:31.507212 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.507178 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hsh8x" event={"ID":"6d7a371e-2869-4317-8eb4-fa094127573b","Type":"ContainerStarted","Data":"a33b90ce5ab67da3c84a0ff4ab0a2828a49e851cdc3403e0c5338079d8a6711b"} Jun 11 21:20:31.508468 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.508448 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vm68" event={"ID":"91216e2c-1808-42a0-ba32-2758680cf590","Type":"ContainerStarted","Data":"cbbcf1416147cf62e24d5d4480f67e3afb0a0316bccd4ae4888d48205c57f049"} Jun 11 21:20:31.509435 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.509417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" event={"ID":"8032af66-0801-46d7-a634-33e8c61792b0","Type":"ContainerStarted","Data":"9d58e9c0df506a4b5d818ae69612fff3751de3f7b0573a4643c23d905d8ffaab"} Jun 11 21:20:31.511264 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.511219 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" event={"ID":"84b106941e4bd3acb99330a3abc18a7d","Type":"ContainerStarted","Data":"5f1078d8879b4f76f3acc8cd0c3499713570b8624ba7e63a5999443b9ef9dc95"} Jun 11 21:20:31.512606 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.512575 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zkbvv" event={"ID":"c03ec144-49ce-48a3-b6ab-2644e556a7e3","Type":"ContainerStarted","Data":"e3b81766b59b8a339f8ab7846bfbd53fce329aefd381b5d92109de05fccb2065"} Jun 11 21:20:31.513653 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.513632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerStarted","Data":"1f70ed6c1cb42997ac0464816184700dba7a96dd8ee1ae37c318d242dc5563ce"} Jun 11 21:20:31.525648 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:31.525604 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-17.ec2.internal" podStartSLOduration=2.525588404 podStartE2EDuration="2.525588404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:31.524919604 +0000 UTC m=+3.469456976" watchObservedRunningTime="2026-06-11 21:20:31.525588404 +0000 UTC m=+3.470125786" Jun 11 21:20:32.052141 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.052052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:32.052141 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.052140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:32.052436 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.052351 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:32.052436 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.052416 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:34.05239762 +0000 UTC m=+5.996934981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:32.052838 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.052807 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:32.052973 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.052865 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret podName:ca6dd972-369c-4017-9d02-85b937fdaa45 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:34.052848905 +0000 UTC m=+5.997386278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret") pod "global-pull-secret-syncer-2ndxt" (UID: "ca6dd972-369c-4017-9d02-85b937fdaa45") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:32.153015 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.152975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:32.153200 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.153152 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:32.153200 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.153173 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:32.153200 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.153185 2563 projected.go:196] Error preparing data for projected volume kube-api-access-b72jz for pod openshift-network-diagnostics/network-check-target-9nqlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:32.153392 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.153243 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz podName:c8f436d5-cebc-4b43-b8bc-056b9e18c947 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:34.153225105 +0000 UTC m=+6.097762482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72jz" (UniqueName: "kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz") pod "network-check-target-9nqlp" (UID: "c8f436d5-cebc-4b43-b8bc-056b9e18c947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:32.467295 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.467140 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:15:30 +0000 UTC" deadline="2028-02-20 05:33:56.835801154 +0000 UTC" Jun 11 21:20:32.467295 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.467205 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14840h13m24.368600504s" Jun 11 21:20:32.497271 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.497240 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:32.497447 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.497424 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:32.497868 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.497841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:32.498012 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.497968 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:32.498077 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.498036 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:32.498129 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:32.498107 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:32.535573 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.534357 2563 generic.go:356] "Generic (PLEG): container finished" podID="140b291ced525d73266b7ccd886aa844" containerID="d30524ece3c3b31886f0c8ec4d5bea26d36a254898d4a019964f5e6e27e076fd" exitCode=0 Jun 11 21:20:32.535573 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:32.535298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"140b291ced525d73266b7ccd886aa844","Type":"ContainerDied","Data":"d30524ece3c3b31886f0c8ec4d5bea26d36a254898d4a019964f5e6e27e076fd"} Jun 11 21:20:33.572640 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:33.572587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" event={"ID":"140b291ced525d73266b7ccd886aa844","Type":"ContainerStarted","Data":"2015ed0a5880c76a473d666f6c95330c061ff05f68ec5788354cf564b5160952"} Jun 11 21:20:34.072701 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:34.072627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:34.072701 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:34.072695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:34.072916 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.072833 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:34.072916 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.072892 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret podName:ca6dd972-369c-4017-9d02-85b937fdaa45 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:38.07287465 +0000 UTC m=+10.017412024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret") pod "global-pull-secret-syncer-2ndxt" (UID: "ca6dd972-369c-4017-9d02-85b937fdaa45") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:34.073029 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.072966 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:34.073029 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.073000 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:38.072989214 +0000 UTC m=+10.017526577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:34.173749 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:34.173710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:34.173925 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.173897 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:34.173925 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.173923 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:34.174045 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.173937 2563 projected.go:196] Error preparing data for projected volume kube-api-access-b72jz for pod openshift-network-diagnostics/network-check-target-9nqlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:34.174045 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.173999 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz podName:c8f436d5-cebc-4b43-b8bc-056b9e18c947 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:38.173979346 +0000 UTC m=+10.118516728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72jz" (UniqueName: "kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz") pod "network-check-target-9nqlp" (UID: "c8f436d5-cebc-4b43-b8bc-056b9e18c947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:34.495015 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:34.494940 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:34.495171 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.495060 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:34.495407 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:34.495376 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:34.495407 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:34.495390 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:34.495596 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.495486 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:34.495596 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:34.495577 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:36.495479 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:36.495443 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:36.495933 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:36.495575 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:36.496032 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:36.496003 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:36.496168 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:36.496148 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:36.496345 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:36.496319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:36.496494 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:36.496463 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:38.108192 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:38.108150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:38.108670 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:38.108240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:38.108670 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.108291 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:38.108670 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.108343 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:38.108670 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.108379 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret podName:ca6dd972-369c-4017-9d02-85b937fdaa45 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:46.108356557 +0000 UTC m=+18.052893936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret") pod "global-pull-secret-syncer-2ndxt" (UID: "ca6dd972-369c-4017-9d02-85b937fdaa45") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:38.108670 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.108402 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:46.108391356 +0000 UTC m=+18.052928729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:38.208800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:38.208757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:38.208995 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.208946 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:38.208995 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.208966 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:38.208995 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.208978 2563 projected.go:196] Error preparing data for projected volume kube-api-access-b72jz for pod openshift-network-diagnostics/network-check-target-9nqlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:38.209097 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.209040 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz podName:c8f436d5-cebc-4b43-b8bc-056b9e18c947 nodeName:}" failed. No retries permitted until 2026-06-11 21:20:46.209022088 +0000 UTC m=+18.153559471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72jz" (UniqueName: "kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz") pod "network-check-target-9nqlp" (UID: "c8f436d5-cebc-4b43-b8bc-056b9e18c947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:38.497827 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:38.497545 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:38.497997 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.497895 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:38.498537 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:38.498269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:38.498537 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.498384 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:38.498537 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:38.498442 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:38.498537 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:38.498504 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:40.494955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:40.494919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:40.495425 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:40.495054 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:40.495543 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:40.495505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:40.495635 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:40.495603 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:40.495740 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:40.495669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:40.495740 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:40.495723 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:41.594727 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.594635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" event={"ID":"8032af66-0801-46d7-a634-33e8c61792b0","Type":"ContainerStarted","Data":"65d4140737f7dccfb42eef43cda5579388f7d4704386f18974cdf9bd8d67e36d"} Jun 11 21:20:41.596522 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.596466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zkbvv" event={"ID":"c03ec144-49ce-48a3-b6ab-2644e556a7e3","Type":"ContainerStarted","Data":"b9082fdaa3fa97e6c44e7d6c7f94d956e23e9ff45b7dc9bb5231afc66456609d"} Jun 11 21:20:41.598319 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.598269 2563 generic.go:356] "Generic (PLEG): container finished" podID="05c02e3d-d937-4ff3-9010-99701fc57d85" containerID="e46efe3309980ae7b70e9f6adf5a6bd725546e6ec9c0616c51036cb6d0cad412" exitCode=0 Jun 11 21:20:41.598447 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.598355 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerDied","Data":"e46efe3309980ae7b70e9f6adf5a6bd725546e6ec9c0616c51036cb6d0cad412"} Jun 11 21:20:41.599954 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.599929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6q2b" event={"ID":"67719a28-cefc-469d-8582-fde072f45b8c","Type":"ContainerStarted","Data":"66b9ed38cd1d3dbe1a5cf7b7509d03bd3cb788dac96af4d4621edc80343ba124"} Jun 11 21:20:41.602243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.602218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" event={"ID":"66f0380c-2550-4899-a72c-79bb54cea20f","Type":"ContainerStarted","Data":"17ebcd3ee5c01b2ddf0d98a5bdc7525d23626f7f21e699104a060a915a4f1601"} Jun 11 21:20:41.604095 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.604070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mpg6h" event={"ID":"efe493e9-bfb7-4cc8-bf80-51daba89e0c4","Type":"ContainerStarted","Data":"74917a2363e113dceedf4e5463f8e7026449d00ebeaace6c827c61298981334f"} Jun 11 21:20:41.611422 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.611374 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zkbvv" podStartSLOduration=3.894368953 podStartE2EDuration="13.611358383s" totalImagesPullingTime="9.71698943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:41.611040208 +0000 UTC m=+13.555577597" watchObservedRunningTime="2026-06-11 21:20:41.611358383 +0000 UTC m=+13.555895782" Jun 11 21:20:41.611550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.611526 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-17.ec2.internal" podStartSLOduration=12.611519025 podStartE2EDuration="12.611519025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:33.588920057 +0000 UTC m=+5.533457439" watchObservedRunningTime="2026-06-11 21:20:41.611519025 +0000 UTC m=+13.556056408" Jun 11 21:20:41.627923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.627884 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f4xqc" podStartSLOduration=3.860465872 podStartE2EDuration="13.627870162s" totalImagesPullingTime="9.76740429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:41.627277736 +0000 UTC m=+13.571815120" watchObservedRunningTime="2026-06-11 21:20:41.627870162 +0000 UTC m=+13.572407539" Jun 11 21:20:41.640547 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.640506 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c6q2b" podStartSLOduration=3.920629096 podStartE2EDuration="13.640494274s" totalImagesPullingTime="9.719865178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:41.640427371 +0000 UTC m=+13.584964753" watchObservedRunningTime="2026-06-11 21:20:41.640494274 +0000 UTC m=+13.585031655" Jun 11 21:20:41.653828 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:41.653793 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mpg6h" podStartSLOduration=3.936870379 podStartE2EDuration="13.653780631s" totalImagesPullingTime="9.716910252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:41.653348509 +0000 UTC m=+13.597885892" watchObservedRunningTime="2026-06-11 21:20:41.653780631 +0000 UTC m=+13.598318011" Jun 11 21:20:42.495332 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:42.495296 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:42.495503 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:42.495297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:42.495503 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:42.495427 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:42.495857 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:42.495822 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:42.495946 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:42.495895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:42.495995 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:42.495979 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:43.610242 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:43.610200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vm68" event={"ID":"91216e2c-1808-42a0-ba32-2758680cf590","Type":"ContainerStarted","Data":"02cffb7f19043a34a698a7f73056db2cd3af6021de7ef6f686bcec7f2fa9f1c7"} Jun 11 21:20:43.624723 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:43.624661 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vm68" podStartSLOduration=5.899782125 podStartE2EDuration="15.624647229s" totalImagesPullingTime="9.724865104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:43.624468234 +0000 UTC m=+15.569005617" watchObservedRunningTime="2026-06-11 21:20:43.624647229 +0000 UTC m=+15.569184618" Jun 11 21:20:44.495348 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:44.495075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:44.495535 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:44.495435 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:44.495535 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:44.495143 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:44.495640 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:44.495556 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:44.495640 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:44.495072 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:44.495722 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:44.495634 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:44.785531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:44.785412 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:44.786298 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:44.786262 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:46.169891 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.169857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:46.170382 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.169929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:46.170382 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.170022 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:46.170382 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.170094 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:02.170071789 +0000 UTC m=+34.114609165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:20:46.170382 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.170025 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:46.170382 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.170178 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret podName:ca6dd972-369c-4017-9d02-85b937fdaa45 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:02.170165066 +0000 UTC m=+34.114702425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret") pod "global-pull-secret-syncer-2ndxt" (UID: "ca6dd972-369c-4017-9d02-85b937fdaa45") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:20:46.270554 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.270522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:46.270796 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.270698 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:20:46.270796 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.270721 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:20:46.270796 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.270738 2563 projected.go:196] Error preparing data for projected volume kube-api-access-b72jz for pod openshift-network-diagnostics/network-check-target-9nqlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:46.270796 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.270793 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz podName:c8f436d5-cebc-4b43-b8bc-056b9e18c947 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:02.270778847 +0000 UTC m=+34.215316225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72jz" (UniqueName: "kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz") pod "network-check-target-9nqlp" (UID: "c8f436d5-cebc-4b43-b8bc-056b9e18c947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:20:46.500880 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.500852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:46.501039 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.501016 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:46.501528 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.501510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:46.501660 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.501639 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:46.501716 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.501704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:46.501851 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:46.501833 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:46.573606 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.573572 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 21:20:46.621513 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.621473 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"d61ad1abdc54146dbed8fe30a53f782c7585d7ee0118451ebd506aac8715535c"} Jun 11 21:20:46.625373 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:46.625247 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" event={"ID":"8032af66-0801-46d7-a634-33e8c61792b0","Type":"ContainerStarted","Data":"798503a5f7d4ddd465ba387df531f9dabf8a813b6c1a310e29a9467fb321f762"} Jun 11 21:20:47.062060 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.062021 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:47.141732 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.141695 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:47.494823 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.493945 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:20:46.573593583Z","UUID":"7675252a-4a22-4a15-98ba-cf8d0c8e2dfa","Handler":null,"Name":"","Endpoint":""} Jun 11 21:20:47.495736 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.495711 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 21:20:47.495821 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.495766 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 21:20:47.632351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.632023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"802bfb96ab17f0fb14db9ebaa004bff2ce6106119af966a0329082d7c27afff3"} Jun 11 21:20:47.632351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.632125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"5742aa1819b8e50d43c0a9e6489510e13bbb8279ec018bcbd8dc4752d1dfccdd"} Jun 11 21:20:47.632351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.632175 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"7565931b31a8bd4057ae250aa9467bd83542fb268c181cebd30b98cccdc2e784"} Jun 11 21:20:47.632351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.632223 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"17515871b823250f59987a73db9d930540a36f2b8f8701f63ac191bed4a5b7a6"} Jun 11 21:20:47.632351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:47.632269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"bfcee26065f69ef83a431ef5568686b2290575554c5e64ba9cea29a9371e9e69"} Jun 11 21:20:48.495435 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:48.495404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:48.495888 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:48.495493 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:48.495888 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:48.495537 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:48.495888 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:48.495639 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:48.495888 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:48.495723 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:48.495888 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:48.495776 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:48.636895 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:48.636847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" event={"ID":"8032af66-0801-46d7-a634-33e8c61792b0","Type":"ContainerStarted","Data":"8e29606cdddc40a56853daa34747f54205e87fa46d93059eab31e3daa7d02e74"} Jun 11 21:20:48.654095 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:48.654044 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqxss" podStartSLOduration=4.43672377 podStartE2EDuration="20.654029923s" totalImagesPullingTime="16.217306153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:48.653757504 +0000 UTC m=+20.598294886" watchObservedRunningTime="2026-06-11 21:20:48.654029923 +0000 UTC m=+20.598567304" Jun 11 21:20:49.643692 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:49.643654 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"9ad274faa701a5083846f9fbde7a133f9172e6877b9d4faf8c73404d7a24604d"} Jun 11 21:20:50.279737 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:50.279702 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:50.332429 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:50.332400 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:50.494533 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:50.494494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:50.494533 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:50.494520 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:50.494786 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:50.494497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:50.494786 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:50.494623 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:50.494786 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:50.494708 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:50.494952 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:50.494782 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:50.974748 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:50.974664 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:51.008832 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:51.008773 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:51.009008 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:51.008909 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 21:20:51.009355 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:51.009332 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mpg6h" Jun 11 21:20:51.027564 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:51.027539 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:51.091047 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:51.090986 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:51.953519 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:51.953487 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:52.005327 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:52.005264 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:52.494832 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:52.494796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:52.495021 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:52.494845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:52.495021 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:52.494796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:52.495021 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:52.494927 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:52.495145 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:52.495043 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:52.495145 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:52.495129 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:52.680845 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:52.680807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:54.495332 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:54.495293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:54.495847 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:54.495275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:54.495847 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:54.495411 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:54.495847 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:54.495302 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:54.495847 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:54.495470 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:54.495847 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:54.495542 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:55.660094 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.659851 2563 generic.go:356] "Generic (PLEG): container finished" podID="05c02e3d-d937-4ff3-9010-99701fc57d85" containerID="c7a3149d0dfa39ce23bc4f50bf4b11b9ba0e90594c5ce456630af8b83f4b6070" exitCode=0 Jun 11 21:20:55.660094 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.659930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerDied","Data":"c7a3149d0dfa39ce23bc4f50bf4b11b9ba0e90594c5ce456630af8b83f4b6070"} Jun 11 21:20:55.663709 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.663680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" event={"ID":"53ded20b-ac9c-4623-909d-27aaa08e76fd","Type":"ContainerStarted","Data":"b68631c362c79728b69e4e4c1354e58cf889dbb5ed1e91cb63b69a6924e1b877"} Jun 11 21:20:55.663971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.663951 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:55.668529 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.668492 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hsh8x" event={"ID":"6d7a371e-2869-4317-8eb4-fa094127573b","Type":"ContainerStarted","Data":"be1143cafadb27cb69a906cab5d8a3866619911b4454c24e553f2a3e609a52ae"} Jun 11 21:20:55.680959 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.680940 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:55.724232 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.724181 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hsh8x" podStartSLOduration=3.759416818 podStartE2EDuration="27.724169016s" totalImagesPullingTime="23.964752198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:55.701119665 +0000 UTC m=+27.645657045" watchObservedRunningTime="2026-06-11 21:20:55.724169016 +0000 UTC m=+27.668706397" Jun 11 21:20:55.724477 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.724449 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" podStartSLOduration=12.595734544 podStartE2EDuration="27.724438454s" totalImagesPullingTime="15.12870391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:20:55.723866546 +0000 UTC m=+27.668403926" watchObservedRunningTime="2026-06-11 21:20:55.724438454 +0000 UTC m=+27.668975835" Jun 11 21:20:55.820519 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.820480 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:55.870148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:55.870114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:56.495393 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.495366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:56.495520 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.495368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:56.495520 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:56.495492 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:56.495607 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.495538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:56.495649 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:56.495621 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:56.495716 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:56.495698 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:56.672569 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.672249 2563 generic.go:356] "Generic (PLEG): container finished" podID="05c02e3d-d937-4ff3-9010-99701fc57d85" containerID="6e9801dd530408748b13902bc40a161f67d7b8b774fca39e032fdaf1ab810a3f" exitCode=0 Jun 11 21:20:56.672950 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.672340 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerDied","Data":"6e9801dd530408748b13902bc40a161f67d7b8b774fca39e032fdaf1ab810a3f"} Jun 11 21:20:56.673414 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.673272 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:56.673414 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.673361 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:56.689599 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:56.689572 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:20:57.105807 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.105772 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2ndxt"] Jun 11 21:20:57.105993 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.105939 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:57.106060 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:57.106036 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:57.109415 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.109387 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pzdps"] Jun 11 21:20:57.109561 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.109502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:57.109623 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:57.109609 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:20:57.110036 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.110013 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9nqlp"] Jun 11 21:20:57.110141 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.110095 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:57.110201 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:57.110168 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:57.470661 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.470630 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:57.567972 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.567939 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:57.679447 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.679416 2563 generic.go:356] "Generic (PLEG): container finished" podID="05c02e3d-d937-4ff3-9010-99701fc57d85" containerID="a1931b14167db0c4de3b0f04b35bf7165b172051b58169430f9ad83920fac333" exitCode=0 Jun 11 21:20:57.679965 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:57.679504 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerDied","Data":"a1931b14167db0c4de3b0f04b35bf7165b172051b58169430f9ad83920fac333"} Jun 11 21:20:58.495410 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:58.495371 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:20:58.495612 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:58.495460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:20:58.495612 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:58.495506 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:20:58.495612 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:58.495534 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:20:58.495612 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:20:58.495548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:20:58.495826 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:20:58.495650 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:21:00.497557 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.497529 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:21:00.497971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.497623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:21:00.497971 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:00.497629 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:21:00.497971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.497650 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:21:00.497971 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:00.497721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ndxt" podUID="ca6dd972-369c-4017-9d02-85b937fdaa45" Jun 11 21:21:00.497971 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:00.497808 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9nqlp" podUID="c8f436d5-cebc-4b43-b8bc-056b9e18c947" Jun 11 21:21:00.851218 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.851146 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-17.ec2.internal" event="NodeReady" Jun 11 21:21:00.851389 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.851275 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 21:21:00.893303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.893251 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9vphm"] Jun 11 21:21:00.897473 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.897444 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6zklz"] Jun 11 21:21:00.897605 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.897570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:00.899904 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.899884 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 21:21:00.900021 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.899919 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2227\"" Jun 11 21:21:00.900021 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.899938 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 21:21:00.901457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.901438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:00.903696 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.903673 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 21:21:00.903806 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.903706 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 21:21:00.903806 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.903766 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94xrb\"" Jun 11 21:21:00.903806 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.903715 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 21:21:00.905854 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.905597 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vphm"] Jun 11 21:21:00.908425 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.908401 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6zklz"] Jun 11 21:21:00.991166 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.991122 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-config-volume\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:00.991166 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.991169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-tmp-dir\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:00.991166 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.991205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtsht\" (UniqueName: \"kubernetes.io/projected/70eb1d10-ae30-413a-aa9b-217e336182a7-kube-api-access-wtsht\") pod \"ingress-canary-6zklz\" (UID: \"70eb1d10-ae30-413a-aa9b-217e336182a7\") " pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:00.991510 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.991357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70eb1d10-ae30-413a-aa9b-217e336182a7-cert\") pod \"ingress-canary-6zklz\" (UID: \"70eb1d10-ae30-413a-aa9b-217e336182a7\") " pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:00.991510 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.991404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvgt\" (UniqueName: \"kubernetes.io/projected/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-kube-api-access-ngvgt\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:00.991510 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:00.991434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.007343 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.007311 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:01.056083 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.056044 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:01.091981 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.091940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvgt\" (UniqueName: \"kubernetes.io/projected/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-kube-api-access-ngvgt\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.092167 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.091990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.092167 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.092044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-config-volume\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.092167 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.092065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-tmp-dir\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.092167 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.092092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtsht\" (UniqueName: \"kubernetes.io/projected/70eb1d10-ae30-413a-aa9b-217e336182a7-kube-api-access-wtsht\") pod \"ingress-canary-6zklz\" (UID: \"70eb1d10-ae30-413a-aa9b-217e336182a7\") " pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:01.092391 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:01.092216 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:01.092391 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.092246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70eb1d10-ae30-413a-aa9b-217e336182a7-cert\") pod \"ingress-canary-6zklz\" (UID: \"70eb1d10-ae30-413a-aa9b-217e336182a7\") " pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:01.092391 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:01.092307 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:21:01.592269558 +0000 UTC m=+33.536806943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:21:01.092500 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.092472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-tmp-dir\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.092976 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.092957 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-config-volume\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.097440 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.097312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/70eb1d10-ae30-413a-aa9b-217e336182a7-cert\") pod \"ingress-canary-6zklz\" (UID: \"70eb1d10-ae30-413a-aa9b-217e336182a7\") " pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:01.101136 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.101088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvgt\" (UniqueName: \"kubernetes.io/projected/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-kube-api-access-ngvgt\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.101913 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.101824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtsht\" (UniqueName: \"kubernetes.io/projected/70eb1d10-ae30-413a-aa9b-217e336182a7-kube-api-access-wtsht\") pod \"ingress-canary-6zklz\" (UID: \"70eb1d10-ae30-413a-aa9b-217e336182a7\") " pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:01.215734 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.215696 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6zklz" Jun 11 21:21:01.596535 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:01.596459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:01.596991 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:01.596644 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:01.596991 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:01.596711 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:21:02.596691444 +0000 UTC m=+34.541228806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:21:02.202229 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.202192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:21:02.202435 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.202299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:21:02.202435 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.202368 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:21:02.202435 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.202390 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:21:02.202569 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.202445 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret podName:ca6dd972-369c-4017-9d02-85b937fdaa45 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:34.202428174 +0000 UTC m=+66.146965537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret") pod "global-pull-secret-syncer-2ndxt" (UID: "ca6dd972-369c-4017-9d02-85b937fdaa45") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:21:02.202569 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.202461 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:34.202454451 +0000 UTC m=+66.146991814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:21:02.303322 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.303268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:21:02.303500 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.303458 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:21:02.303500 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.303482 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:21:02.303500 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.303496 2563 projected.go:196] Error preparing data for projected volume kube-api-access-b72jz for pod openshift-network-diagnostics/network-check-target-9nqlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:21:02.303627 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.303555 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz podName:c8f436d5-cebc-4b43-b8bc-056b9e18c947 nodeName:}" failed. No retries permitted until 2026-06-11 21:21:34.303535521 +0000 UTC m=+66.248072880 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72jz" (UniqueName: "kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz") pod "network-check-target-9nqlp" (UID: "c8f436d5-cebc-4b43-b8bc-056b9e18c947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:21:02.498660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.498628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:21:02.498660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.498665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:21:02.499040 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.498628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:21:02.502673 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.502652 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:21:02.502673 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.502656 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:21:02.502851 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.502668 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:21:02.502851 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.502667 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj6vl\"" Jun 11 21:21:02.502851 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.502761 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:21:02.503015 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.502997 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l7p7b\"" Jun 11 21:21:02.605456 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.605423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:02.605815 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.605557 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:02.605815 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:02.605625 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:21:04.605608287 +0000 UTC m=+36.550145667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:21:02.771777 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:02.771712 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6zklz"] Jun 11 21:21:02.845694 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:21:02.845654 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70eb1d10_ae30_413a_aa9b_217e336182a7.slice/crio-4e599af8f4500f16d2ec3a49ce6f7c4e1be96ac4f5a1e106ef7c0f705ef2e8f2 WatchSource:0}: Error finding container 4e599af8f4500f16d2ec3a49ce6f7c4e1be96ac4f5a1e106ef7c0f705ef2e8f2: Status 404 returned error can't find the container with id 4e599af8f4500f16d2ec3a49ce6f7c4e1be96ac4f5a1e106ef7c0f705ef2e8f2 Jun 11 21:21:03.696247 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:03.696017 2563 generic.go:356] "Generic (PLEG): container finished" podID="05c02e3d-d937-4ff3-9010-99701fc57d85" containerID="c34c961021d148bc0408274801efaea53d3d4ec246cbb35b2e52995f3cd5e686" exitCode=0 Jun 11 21:21:03.696707 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:03.696106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerDied","Data":"c34c961021d148bc0408274801efaea53d3d4ec246cbb35b2e52995f3cd5e686"} Jun 11 21:21:03.697558 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:03.697535 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6zklz" event={"ID":"70eb1d10-ae30-413a-aa9b-217e336182a7","Type":"ContainerStarted","Data":"4e599af8f4500f16d2ec3a49ce6f7c4e1be96ac4f5a1e106ef7c0f705ef2e8f2"} Jun 11 21:21:04.161982 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:04.161949 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:04.622447 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:04.622408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:04.622616 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:04.622524 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:04.622616 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:04.622575 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:21:08.622562495 +0000 UTC m=+40.567099856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:21:04.703958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:04.703923 2563 generic.go:356] "Generic (PLEG): container finished" podID="05c02e3d-d937-4ff3-9010-99701fc57d85" containerID="b772d3860a72286e7197d78581074ba9492623b8992a678b7020c0037de2ab88" exitCode=0 Jun 11 21:21:04.704408 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:04.704000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerDied","Data":"b772d3860a72286e7197d78581074ba9492623b8992a678b7020c0037de2ab88"} Jun 11 21:21:05.709450 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:05.709423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-292vv" event={"ID":"05c02e3d-d937-4ff3-9010-99701fc57d85","Type":"ContainerStarted","Data":"d33782318cfb898d18be9015f989fe86e0c3c3119249f9a9dcc9363d13465e85"} Jun 11 21:21:05.740392 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:05.740349 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-292vv" podStartSLOduration=8.051872666 podStartE2EDuration="37.740331782s" totalImagesPullingTime="29.688459116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:05.739027587 +0000 UTC m=+37.683564969" watchObservedRunningTime="2026-06-11 21:21:05.740331782 +0000 UTC m=+37.684869164" Jun 11 21:21:05.860357 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:05.860317 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:05.909208 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:05.909157 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:06.062650 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:06.062610 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:06.122828 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:06.122789 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:06.713471 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:06.713439 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6zklz" event={"ID":"70eb1d10-ae30-413a-aa9b-217e336182a7","Type":"ContainerStarted","Data":"35a7a64ce126ca4724fdbff42f80cf5ebbf3de22bf6d310ae9bd84e2e1edc9b6"} Jun 11 21:21:06.729764 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:06.729717 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6zklz" podStartSLOduration=3.886567883 podStartE2EDuration="6.72970158s" totalImagesPullingTime="2.843133697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:06.728766408 +0000 UTC m=+38.673303786" watchObservedRunningTime="2026-06-11 21:21:06.72970158 +0000 UTC m=+38.674239011" Jun 11 21:21:08.186434 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:08.186371 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:08.242734 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:08.242704 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:08.650058 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:08.650019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:08.650223 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:08.650171 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:08.650300 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:08.650235 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:21:16.650220122 +0000 UTC m=+48.594757484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:21:12.385951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:12.385914 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:12.445790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:12.445751 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:14.228072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:14.228035 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:14.281656 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:14.281625 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:16.706316 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:16.706267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:16.706745 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:16.706401 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:16.706745 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:16.706474 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:21:32.706458649 +0000 UTC m=+64.650996008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:21:28.692233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:28.692204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jttt" Jun 11 21:21:28.848905 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:28.848871 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:28.907851 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:28.907809 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:28.990584 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:28.990554 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:29.056601 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:29.056574 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:29.109979 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:29.109950 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:32.716168 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:32.716128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:21:32.716585 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:32.716258 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:21:32.716585 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:32.716339 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:22:04.716324429 +0000 UTC m=+96.660861807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:21:34.227115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.227073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:21:34.227601 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.227127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:21:34.229814 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.229792 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:21:34.229952 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.229840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:21:34.237928 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:34.237901 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:21:34.238021 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:21:34.237976 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:22:38.237955707 +0000 UTC m=+130.182493084 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : secret "metrics-daemon-secret" not found Jun 11 21:21:34.241190 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.241162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca6dd972-369c-4017-9d02-85b937fdaa45-original-pull-secret\") pod \"global-pull-secret-syncer-2ndxt\" (UID: \"ca6dd972-369c-4017-9d02-85b937fdaa45\") " pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:21:34.315473 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.315434 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ndxt" Jun 11 21:21:34.327690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.327657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:21:34.330642 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.330624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:21:34.341236 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.341210 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:21:34.352101 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.352071 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b72jz\" (UniqueName: \"kubernetes.io/projected/c8f436d5-cebc-4b43-b8bc-056b9e18c947-kube-api-access-b72jz\") pod \"network-check-target-9nqlp\" (UID: \"c8f436d5-cebc-4b43-b8bc-056b9e18c947\") " pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:21:34.438224 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.438191 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2ndxt"] Jun 11 21:21:34.441780 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:21:34.441748 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6dd972_369c_4017_9d02_85b937fdaa45.slice/crio-5638875753f4d6308175f6be6d8a16189db95ab6c49d106e6a8a9d5001589885 WatchSource:0}: Error finding container 5638875753f4d6308175f6be6d8a16189db95ab6c49d106e6a8a9d5001589885: Status 404 returned error can't find the container with id 5638875753f4d6308175f6be6d8a16189db95ab6c49d106e6a8a9d5001589885 Jun 11 21:21:34.622205 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.622124 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tj6vl\"" Jun 11 21:21:34.630579 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.630556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:21:34.763680 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.763641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9nqlp"] Jun 11 21:21:34.766239 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:21:34.766216 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f436d5_cebc_4b43_b8bc_056b9e18c947.slice/crio-ec3eb126bbdb0882283cb83a965f019cb6b98612dafd02c28fdcabde09f9bbfa WatchSource:0}: Error finding container ec3eb126bbdb0882283cb83a965f019cb6b98612dafd02c28fdcabde09f9bbfa: Status 404 returned error can't find the container with id ec3eb126bbdb0882283cb83a965f019cb6b98612dafd02c28fdcabde09f9bbfa Jun 11 21:21:34.782645 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.782617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2ndxt" event={"ID":"ca6dd972-369c-4017-9d02-85b937fdaa45","Type":"ContainerStarted","Data":"5638875753f4d6308175f6be6d8a16189db95ab6c49d106e6a8a9d5001589885"} Jun 11 21:21:34.783577 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:34.783552 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9nqlp" event={"ID":"c8f436d5-cebc-4b43-b8bc-056b9e18c947","Type":"ContainerStarted","Data":"ec3eb126bbdb0882283cb83a965f019cb6b98612dafd02c28fdcabde09f9bbfa"} Jun 11 21:21:36.917754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:36.917681 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:39.800188 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:39.800141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2ndxt" event={"ID":"ca6dd972-369c-4017-9d02-85b937fdaa45","Type":"ContainerStarted","Data":"572135908c4fa4b6896be4d9f360220e710c6fbea5e429509cbc6f0367e67412"} Jun 11 21:21:39.801785 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:39.801756 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9nqlp" event={"ID":"c8f436d5-cebc-4b43-b8bc-056b9e18c947","Type":"ContainerStarted","Data":"3969977c0bf3a7fddd92bdfd06034bd999e39cb5ffd144d19f4921266fc6c0ba"} Jun 11 21:21:39.801918 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:39.801903 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:21:39.815889 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:39.815458 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2ndxt" podStartSLOduration=66.671513088 podStartE2EDuration="1m11.815439847s" totalImagesPullingTime="5.143926759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:39.814445251 +0000 UTC m=+71.758982657" watchObservedRunningTime="2026-06-11 21:21:39.815439847 +0000 UTC m=+71.759977229" Jun 11 21:21:39.830100 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:21:39.830056 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9nqlp" podStartSLOduration=67.01290747 podStartE2EDuration="1m11.83004141s" totalImagesPullingTime="4.81713394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:21:39.829304555 +0000 UTC m=+71.773841931" watchObservedRunningTime="2026-06-11 21:21:39.83004141 +0000 UTC m=+71.774578790" Jun 11 21:22:04.740076 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:22:04.740039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:22:04.740629 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:22:04.740164 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:22:04.740629 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:22:04.740223 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:23:08.740206504 +0000 UTC m=+160.684743864 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:22:10.807630 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:22:10.807599 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9nqlp" Jun 11 21:22:38.262593 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:22:38.262545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:22:38.263081 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:22:38.262667 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:22:38.263081 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:22:38.262733 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs podName:bd92ef1c-51b4-4a53-bcb4-3e1901dbe949 nodeName:}" failed. No retries permitted until 2026-06-11 21:24:40.262718202 +0000 UTC m=+252.207255561 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs") pod "network-metrics-daemon-pzdps" (UID: "bd92ef1c-51b4-4a53-bcb4-3e1901dbe949") : secret "metrics-daemon-secret" not found Jun 11 21:22:58.887963 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:22:58.887922 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:03.910701 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:03.910636 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9vphm" podUID="e6f00c64-ef93-4f21-8468-93f4ee6cc61f" Jun 11 21:23:04.000845 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:04.000817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vphm" Jun 11 21:23:05.509749 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:05.509708 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pzdps" podUID="bd92ef1c-51b4-4a53-bcb4-3e1901dbe949" Jun 11 21:23:08.768647 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:08.768606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:23:08.769036 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:08.768763 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:23:08.769036 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:08.768830 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls podName:e6f00c64-ef93-4f21-8468-93f4ee6cc61f nodeName:}" failed. No retries permitted until 2026-06-11 21:25:10.76881381 +0000 UTC m=+282.713351168 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls") pod "dns-default-9vphm" (UID: "e6f00c64-ef93-4f21-8468-93f4ee6cc61f") : secret "dns-default-metrics-tls" not found Jun 11 21:23:19.495128 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:19.495015 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:23:21.343951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.343914 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kgtvc"] Jun 11 21:23:21.346067 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.346043 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.349015 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.348997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.350063 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.350037 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-44zrs\"" Jun 11 21:23:21.350233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.350218 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.350320 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.350218 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 21:23:21.351175 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.351161 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 21:23:21.353768 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.353753 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 21:23:21.361833 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.361813 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kgtvc"] Jun 11 21:23:21.439614 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.439584 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq"] Jun 11 21:23:21.441531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.441505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" Jun 11 21:23:21.443051 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.443025 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw"] Jun 11 21:23:21.443978 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.443962 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5zh96\"" Jun 11 21:23:21.445008 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.444992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.447127 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.447111 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 21:23:21.447333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.447319 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 21:23:21.447547 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.447532 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.447734 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.447713 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v7xxn\"" Jun 11 21:23:21.447844 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.447741 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.456957 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.456928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq"] Jun 11 21:23:21.457167 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.457141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dc7c258-a851-4895-bd3e-f15e41c9c45c-config\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.457296 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.457178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrh9r\" (UniqueName: \"kubernetes.io/projected/3dc7c258-a851-4895-bd3e-f15e41c9c45c-kube-api-access-xrh9r\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.457296 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.457202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dc7c258-a851-4895-bd3e-f15e41c9c45c-serving-cert\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.457296 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.457227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dc7c258-a851-4895-bd3e-f15e41c9c45c-trusted-ca\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.457695 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.457673 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw"] Jun 11 21:23:21.541547 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.541511 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2"] Jun 11 21:23:21.543989 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.543973 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b6ff49fdb-cpm2b"] Jun 11 21:23:21.544121 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.544105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.546067 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.546029 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.546757 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.546732 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 21:23:21.547155 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.547127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hbppw\"" Jun 11 21:23:21.547350 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.547332 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 21:23:21.547598 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.547584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 21:23:21.547652 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.547607 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 21:23:21.548517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.548500 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 21:23:21.548876 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.548853 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgf6c\"" Jun 11 21:23:21.548929 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.548853 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 21:23:21.548929 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.548919 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 21:23:21.553125 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.553103 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2"] Jun 11 21:23:21.554093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.554074 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 21:23:21.557634 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dc7c258-a851-4895-bd3e-f15e41c9c45c-serving-cert\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.557744 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dc7c258-a851-4895-bd3e-f15e41c9c45c-trusted-ca\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.557744 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fnxx\" (UniqueName: \"kubernetes.io/projected/e61e665c-e389-446b-90b2-677b21779296-kube-api-access-7fnxx\") pod \"network-check-source-6947749cfc-mkbkq\" (UID: \"e61e665c-e389-446b-90b2-677b21779296\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" Jun 11 21:23:21.557744 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjvk\" (UniqueName: \"kubernetes.io/projected/861761bd-5375-43e3-8e04-50b0485ebb9c-kube-api-access-6vjvk\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.557936 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/861761bd-5375-43e3-8e04-50b0485ebb9c-config\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.557936 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dc7c258-a851-4895-bd3e-f15e41c9c45c-config\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.557936 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrh9r\" (UniqueName: \"kubernetes.io/projected/3dc7c258-a851-4895-bd3e-f15e41c9c45c-kube-api-access-xrh9r\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.557936 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.557901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/861761bd-5375-43e3-8e04-50b0485ebb9c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.558380 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.558356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b6ff49fdb-cpm2b"] Jun 11 21:23:21.559146 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.559119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3dc7c258-a851-4895-bd3e-f15e41c9c45c-config\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.559243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.559170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dc7c258-a851-4895-bd3e-f15e41c9c45c-trusted-ca\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.561090 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.561067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3dc7c258-a851-4895-bd3e-f15e41c9c45c-serving-cert\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.573914 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.573890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrh9r\" (UniqueName: \"kubernetes.io/projected/3dc7c258-a851-4895-bd3e-f15e41c9c45c-kube-api-access-xrh9r\") pod \"console-operator-5dbbb5d744-kgtvc\" (UID: \"3dc7c258-a851-4895-bd3e-f15e41c9c45c\") " pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.656403 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.656301 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:21.658565 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjvk\" (UniqueName: \"kubernetes.io/projected/861761bd-5375-43e3-8e04-50b0485ebb9c-kube-api-access-6vjvk\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.658682 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/861761bd-5375-43e3-8e04-50b0485ebb9c-config\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.658682 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d8ce527-2d34-4120-b0e9-25b1b011ce64-ca-trust-extracted\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.658682 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-installation-pull-secrets\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.658682 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-bound-sa-token\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.658851 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-image-registry-private-configuration\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.658851 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrrtp\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-kube-api-access-mrrtp\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.658949 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.658949 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/861761bd-5375-43e3-8e04-50b0485ebb9c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.658949 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d0ef2266-ef72-4b79-9299-65aa62a1c548-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.658949 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n4hs\" (UniqueName: \"kubernetes.io/projected/d0ef2266-ef72-4b79-9299-65aa62a1c548-kube-api-access-6n4hs\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.659131 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.658980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.659131 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.659000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-certificates\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.659131 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.659023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-trusted-ca\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.659131 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.659057 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fnxx\" (UniqueName: \"kubernetes.io/projected/e61e665c-e389-446b-90b2-677b21779296-kube-api-access-7fnxx\") pod \"network-check-source-6947749cfc-mkbkq\" (UID: \"e61e665c-e389-446b-90b2-677b21779296\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" Jun 11 21:23:21.659655 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.659163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/861761bd-5375-43e3-8e04-50b0485ebb9c-config\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.661338 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.661314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/861761bd-5375-43e3-8e04-50b0485ebb9c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.666946 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.666900 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:21.667558 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.667539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjvk\" (UniqueName: \"kubernetes.io/projected/861761bd-5375-43e3-8e04-50b0485ebb9c-kube-api-access-6vjvk\") pod \"service-ca-operator-7ccbfd59dc-wwcdw\" (UID: \"861761bd-5375-43e3-8e04-50b0485ebb9c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.667654 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.667629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fnxx\" (UniqueName: \"kubernetes.io/projected/e61e665c-e389-446b-90b2-677b21779296-kube-api-access-7fnxx\") pod \"network-check-source-6947749cfc-mkbkq\" (UID: \"e61e665c-e389-446b-90b2-677b21779296\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" Jun 11 21:23:21.718584 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.718552 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:21.751574 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.751542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" Jun 11 21:23:21.757411 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.757383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" Jun 11 21:23:21.759687 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d8ce527-2d34-4120-b0e9-25b1b011ce64-ca-trust-extracted\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.759813 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-installation-pull-secrets\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.759813 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759720 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-bound-sa-token\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.759813 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-image-registry-private-configuration\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.759813 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrrtp\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-kube-api-access-mrrtp\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.759813 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759795 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.760093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d0ef2266-ef72-4b79-9299-65aa62a1c548-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.760093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n4hs\" (UniqueName: \"kubernetes.io/projected/d0ef2266-ef72-4b79-9299-65aa62a1c548-kube-api-access-6n4hs\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.760093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.760093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-certificates\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.760093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.759956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-trusted-ca\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.760093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.760022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d8ce527-2d34-4120-b0e9-25b1b011ce64-ca-trust-extracted\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.760531 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:21.760110 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:23:21.760531 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:21.760130 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b6ff49fdb-cpm2b: secret "image-registry-tls" not found Jun 11 21:23:21.760531 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:21.760191 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls podName:9d8ce527-2d34-4120-b0e9-25b1b011ce64 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:22.260169817 +0000 UTC m=+174.204707192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls") pod "image-registry-7b6ff49fdb-cpm2b" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64") : secret "image-registry-tls" not found Jun 11 21:23:21.761724 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:21.760832 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:21.761724 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:21.760895 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls podName:d0ef2266-ef72-4b79-9299-65aa62a1c548 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:22.260876286 +0000 UTC m=+174.205413651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-v2pm2" (UID: "d0ef2266-ef72-4b79-9299-65aa62a1c548") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:21.761724 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.760909 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-trusted-ca\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.761724 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.761532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-certificates\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.761724 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.761615 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d0ef2266-ef72-4b79-9299-65aa62a1c548-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.763338 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.763318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-image-registry-private-configuration\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.763431 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.763353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-installation-pull-secrets\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.774206 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.774179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n4hs\" (UniqueName: \"kubernetes.io/projected/d0ef2266-ef72-4b79-9299-65aa62a1c548-kube-api-access-6n4hs\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:21.776070 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.775201 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrrtp\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-kube-api-access-mrrtp\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.776070 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.775518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-bound-sa-token\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:21.789106 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.789031 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-kgtvc"] Jun 11 21:23:21.791728 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:21.791694 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc7c258_a851_4895_bd3e_f15e41c9c45c.slice/crio-e70f5dfecb642d37247069ebbb3dc4b935d34342bb4b2ed82fad2e00405e5415 WatchSource:0}: Error finding container e70f5dfecb642d37247069ebbb3dc4b935d34342bb4b2ed82fad2e00405e5415: Status 404 returned error can't find the container with id e70f5dfecb642d37247069ebbb3dc4b935d34342bb4b2ed82fad2e00405e5415 Jun 11 21:23:21.885785 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.885749 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq"] Jun 11 21:23:21.888236 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:21.888206 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61e665c_e389_446b_90b2_677b21779296.slice/crio-34e34e8c07bf721091bca2a5835b2d1bc427883f6c4492aebd365d89da77f16d WatchSource:0}: Error finding container 34e34e8c07bf721091bca2a5835b2d1bc427883f6c4492aebd365d89da77f16d: Status 404 returned error can't find the container with id 34e34e8c07bf721091bca2a5835b2d1bc427883f6c4492aebd365d89da77f16d Jun 11 21:23:21.899002 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:21.898974 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw"] Jun 11 21:23:21.901917 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:21.901886 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861761bd_5375_43e3_8e04_50b0485ebb9c.slice/crio-38292a5824d36134f62d516d4904bf8427bfe05b36bcb04285821a3bc16ee723 WatchSource:0}: Error finding container 38292a5824d36134f62d516d4904bf8427bfe05b36bcb04285821a3bc16ee723: Status 404 returned error can't find the container with id 38292a5824d36134f62d516d4904bf8427bfe05b36bcb04285821a3bc16ee723 Jun 11 21:23:22.045944 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:22.045907 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" event={"ID":"e61e665c-e389-446b-90b2-677b21779296","Type":"ContainerStarted","Data":"3c37b1ebbeb007d0bb76499af2a76d2d919498bf995440f909661670272e7a1a"} Jun 11 21:23:22.046140 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:22.045969 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" event={"ID":"e61e665c-e389-446b-90b2-677b21779296","Type":"ContainerStarted","Data":"34e34e8c07bf721091bca2a5835b2d1bc427883f6c4492aebd365d89da77f16d"} Jun 11 21:23:22.047154 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:22.047128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" event={"ID":"861761bd-5375-43e3-8e04-50b0485ebb9c","Type":"ContainerStarted","Data":"38292a5824d36134f62d516d4904bf8427bfe05b36bcb04285821a3bc16ee723"} Jun 11 21:23:22.048131 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:22.048109 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" event={"ID":"3dc7c258-a851-4895-bd3e-f15e41c9c45c","Type":"ContainerStarted","Data":"e70f5dfecb642d37247069ebbb3dc4b935d34342bb4b2ed82fad2e00405e5415"} Jun 11 21:23:22.060160 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:22.060114 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-mkbkq" podStartSLOduration=1.060098452 podStartE2EDuration="1.060098452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:22.059459082 +0000 UTC m=+174.003996476" watchObservedRunningTime="2026-06-11 21:23:22.060098452 +0000 UTC m=+174.004635834" Jun 11 21:23:22.263831 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:22.263796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:22.264012 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:22.263866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:22.264012 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:22.263971 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:23:22.264012 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:22.263984 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:22.264012 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:22.263996 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b6ff49fdb-cpm2b: secret "image-registry-tls" not found Jun 11 21:23:22.264172 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:22.264049 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls podName:d0ef2266-ef72-4b79-9299-65aa62a1c548 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:23.264034076 +0000 UTC m=+175.208571455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-v2pm2" (UID: "d0ef2266-ef72-4b79-9299-65aa62a1c548") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:22.264172 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:22.264065 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls podName:9d8ce527-2d34-4120-b0e9-25b1b011ce64 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:23.264058393 +0000 UTC m=+175.208595752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls") pod "image-registry-7b6ff49fdb-cpm2b" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64") : secret "image-registry-tls" not found Jun 11 21:23:23.272136 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:23.272097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:23.272634 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:23.272181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:23.272634 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:23.272331 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:23.272634 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:23.272406 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls podName:d0ef2266-ef72-4b79-9299-65aa62a1c548 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.272382114 +0000 UTC m=+177.216919487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-v2pm2" (UID: "d0ef2266-ef72-4b79-9299-65aa62a1c548") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:23.272634 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:23.272441 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:23:23.272634 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:23.272466 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b6ff49fdb-cpm2b: secret "image-registry-tls" not found Jun 11 21:23:23.272634 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:23.272527 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls podName:9d8ce527-2d34-4120-b0e9-25b1b011ce64 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.272510198 +0000 UTC m=+177.217047560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls") pod "image-registry-7b6ff49fdb-cpm2b" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64") : secret "image-registry-tls" not found Jun 11 21:23:23.304014 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:23.303979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:23.407523 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:23.407483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:24.993468 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:24.993436 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t2w4f"] Jun 11 21:23:24.996317 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:24.996299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:24.998812 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:24.998791 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 21:23:24.999354 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:24.999335 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 21:23:24.999478 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:24.999463 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 21:23:24.999906 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:24.999886 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 21:23:25.000012 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:24.999906 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tnblg\"" Jun 11 21:23:25.011240 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.011218 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t2w4f"] Jun 11 21:23:25.032419 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.032381 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:25.062142 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.062103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" event={"ID":"861761bd-5375-43e3-8e04-50b0485ebb9c","Type":"ContainerStarted","Data":"b66d20100f5b9877fb261982da270a7de876b4f64b3bedbadaf725908a6381dd"} Jun 11 21:23:25.063644 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.063622 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/0.log" Jun 11 21:23:25.063759 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.063667 2563 generic.go:356] "Generic (PLEG): container finished" podID="3dc7c258-a851-4895-bd3e-f15e41c9c45c" containerID="c29532d5073a78d99989437af8a16f4804d324bba5ca2eb98f5904d1bef31ef2" exitCode=255 Jun 11 21:23:25.063759 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.063694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" event={"ID":"3dc7c258-a851-4895-bd3e-f15e41c9c45c","Type":"ContainerDied","Data":"c29532d5073a78d99989437af8a16f4804d324bba5ca2eb98f5904d1bef31ef2"} Jun 11 21:23:25.063897 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.063883 2563 scope.go:117] "RemoveContainer" containerID="c29532d5073a78d99989437af8a16f4804d324bba5ca2eb98f5904d1bef31ef2" Jun 11 21:23:25.092077 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.092014 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" podStartSLOduration=1.578809371 podStartE2EDuration="4.091994713s" totalImagesPullingTime="2.513185342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:25.075686166 +0000 UTC m=+177.020223548" watchObservedRunningTime="2026-06-11 21:23:25.091994713 +0000 UTC m=+177.036532095" Jun 11 21:23:25.187860 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.187816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5369e28-ac8b-448d-8451-c10c33268f3b-crio-socket\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.188015 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.187909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.188015 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.187988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5369e28-ac8b-448d-8451-c10c33268f3b-data-volume\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.188132 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.188016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.188132 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.188042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tckkr\" (UniqueName: \"kubernetes.io/projected/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-api-access-tckkr\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.289000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.288903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:25.289000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.288948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:25.289000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.288993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5369e28-ac8b-448d-8451-c10c33268f3b-crio-socket\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.289010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.289044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5369e28-ac8b-448d-8451-c10c33268f3b-data-volume\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.289068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289070 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.289111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tckkr\" (UniqueName: \"kubernetes.io/projected/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-api-access-tckkr\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289121 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289137 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289152 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.289138 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5369e28-ac8b-448d-8451-c10c33268f3b-crio-socket\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289146 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls podName:d0ef2266-ef72-4b79-9299-65aa62a1c548 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:29.289127842 +0000 UTC m=+181.233665217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-v2pm2" (UID: "d0ef2266-ef72-4b79-9299-65aa62a1c548") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289143 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b6ff49fdb-cpm2b: secret "image-registry-tls" not found Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289245 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.789228023 +0000 UTC m=+177.733765387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : configmap "kube-rbac-proxy" not found Jun 11 21:23:25.289265 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289262 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:25.789253425 +0000 UTC m=+177.733790788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:25.289788 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.289309 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls podName:9d8ce527-2d34-4120-b0e9-25b1b011ce64 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:29.289300082 +0000 UTC m=+181.233837446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls") pod "image-registry-7b6ff49fdb-cpm2b" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64") : secret "image-registry-tls" not found Jun 11 21:23:25.289788 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.289471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5369e28-ac8b-448d-8451-c10c33268f3b-data-volume\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.296541 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.296519 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tckkr\" (UniqueName: \"kubernetes.io/projected/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-api-access-tckkr\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.586163 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.586073 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:25.609721 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.609692 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz"] Jun 11 21:23:25.612900 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.612886 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" Jun 11 21:23:25.616022 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.615997 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sxpcx\"" Jun 11 21:23:25.616276 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.616089 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 21:23:25.616360 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.616343 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 21:23:25.622734 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.622709 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz"] Jun 11 21:23:25.687260 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.687224 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:25.787944 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.787908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:25.792992 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.792966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kjrf\" (UniqueName: \"kubernetes.io/projected/dd8e9ad4-02dc-4997-94d8-f58b5a532c29-kube-api-access-5kjrf\") pod \"migrator-d4bcd4867-fplqz\" (UID: \"dd8e9ad4-02dc-4997-94d8-f58b5a532c29\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" Jun 11 21:23:25.793070 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.793017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.793116 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.793089 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:25.793167 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.793157 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:26.793136375 +0000 UTC m=+178.737673749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : configmap "kube-rbac-proxy" not found Jun 11 21:23:25.793225 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.793190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:25.793401 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.793383 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:25.793475 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:25.793436 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:26.79342404 +0000 UTC m=+178.737961401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:25.894625 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.894525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kjrf\" (UniqueName: \"kubernetes.io/projected/dd8e9ad4-02dc-4997-94d8-f58b5a532c29-kube-api-access-5kjrf\") pod \"migrator-d4bcd4867-fplqz\" (UID: \"dd8e9ad4-02dc-4997-94d8-f58b5a532c29\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" Jun 11 21:23:25.902448 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.902417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kjrf\" (UniqueName: \"kubernetes.io/projected/dd8e9ad4-02dc-4997-94d8-f58b5a532c29-kube-api-access-5kjrf\") pod \"migrator-d4bcd4867-fplqz\" (UID: \"dd8e9ad4-02dc-4997-94d8-f58b5a532c29\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" Jun 11 21:23:25.922399 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:25.922373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" Jun 11 21:23:26.054525 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.054490 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz"] Jun 11 21:23:26.057515 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:26.057483 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8e9ad4_02dc_4997_94d8_f58b5a532c29.slice/crio-7c95e9c8264378edaa08e9a6423c75429e6b28abd326fbfbb5e20d13786bb843 WatchSource:0}: Error finding container 7c95e9c8264378edaa08e9a6423c75429e6b28abd326fbfbb5e20d13786bb843: Status 404 returned error can't find the container with id 7c95e9c8264378edaa08e9a6423c75429e6b28abd326fbfbb5e20d13786bb843 Jun 11 21:23:26.068350 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.068316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" event={"ID":"dd8e9ad4-02dc-4997-94d8-f58b5a532c29","Type":"ContainerStarted","Data":"7c95e9c8264378edaa08e9a6423c75429e6b28abd326fbfbb5e20d13786bb843"} Jun 11 21:23:26.069910 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.069890 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:23:26.070330 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.070311 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/0.log" Jun 11 21:23:26.070422 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.070353 2563 generic.go:356] "Generic (PLEG): container finished" podID="3dc7c258-a851-4895-bd3e-f15e41c9c45c" containerID="5d857cf76dfaafaf0f0382814d6b6c1d378e25736aa263c939b83cd740b02d7e" exitCode=255 Jun 11 21:23:26.070479 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.070445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" event={"ID":"3dc7c258-a851-4895-bd3e-f15e41c9c45c","Type":"ContainerDied","Data":"5d857cf76dfaafaf0f0382814d6b6c1d378e25736aa263c939b83cd740b02d7e"} Jun 11 21:23:26.070524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.070500 2563 scope.go:117] "RemoveContainer" containerID="c29532d5073a78d99989437af8a16f4804d324bba5ca2eb98f5904d1bef31ef2" Jun 11 21:23:26.070773 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.070748 2563 scope.go:117] "RemoveContainer" containerID="5d857cf76dfaafaf0f0382814d6b6c1d378e25736aa263c939b83cd740b02d7e" Jun 11 21:23:26.070961 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:26.070938 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kgtvc_openshift-console-operator(3dc7c258-a851-4895-bd3e-f15e41c9c45c)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" podUID="3dc7c258-a851-4895-bd3e-f15e41c9c45c" Jun 11 21:23:26.406175 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.406144 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:26.505194 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.505156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:26.800184 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.800148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:26.800396 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.800207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:26.800396 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:26.800313 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:26.800396 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:26.800365 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:26.800570 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:26.800397 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:28.800376182 +0000 UTC m=+180.744913552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : configmap "kube-rbac-proxy" not found Jun 11 21:23:26.800570 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:26.800424 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:28.800406548 +0000 UTC m=+180.744943929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:26.853233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.853191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:26.897808 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:26.897771 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:27.076143 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:27.076069 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:23:27.076615 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:27.076493 2563 scope.go:117] "RemoveContainer" containerID="5d857cf76dfaafaf0f0382814d6b6c1d378e25736aa263c939b83cd740b02d7e" Jun 11 21:23:27.076699 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:27.076676 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kgtvc_openshift-console-operator(3dc7c258-a851-4895-bd3e-f15e41c9c45c)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" podUID="3dc7c258-a851-4895-bd3e-f15e41c9c45c" Jun 11 21:23:27.118624 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:27.118539 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:27.156892 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:27.156856 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zkbvv_c03ec144-49ce-48a3-b6ab-2644e556a7e3/dns-node-resolver/0.log" Jun 11 21:23:28.084754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.084715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" event={"ID":"dd8e9ad4-02dc-4997-94d8-f58b5a532c29","Type":"ContainerStarted","Data":"ec86cb5d08745c4c29556db86c4e0fd1e1b36d240533b8aeff38f45343ae82c1"} Jun 11 21:23:28.085121 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.084814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" event={"ID":"dd8e9ad4-02dc-4997-94d8-f58b5a532c29","Type":"ContainerStarted","Data":"d52fcbe324b7093147e6702f9b9063a8e9a06d862548813688a61af65ba852e8"} Jun 11 21:23:28.087964 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.087938 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:28.108945 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.108900 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-fplqz" podStartSLOduration=1.920427256 podStartE2EDuration="3.108886818s" totalImagesPullingTime="1.188459562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:28.107963462 +0000 UTC m=+180.052500844" watchObservedRunningTime="2026-06-11 21:23:28.108886818 +0000 UTC m=+180.053424198" Jun 11 21:23:28.158532 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.158512 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6q2b_67719a28-cefc-469d-8582-fde072f45b8c/node-ca/0.log" Jun 11 21:23:28.189969 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.189938 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:28.242751 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.242718 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:28.753400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.753358 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:28.756919 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.756894 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6zklz_70eb1d10-ae30-413a-aa9b-217e336182a7/serve-healthcheck-canary/0.log" Jun 11 21:23:28.800340 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.800301 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:28.813041 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.813018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:28.813133 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:28.813056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:28.813177 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:28.813133 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:28.813177 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:28.813149 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:28.813251 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:28.813193 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:32.813177739 +0000 UTC m=+184.757715101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : configmap "kube-rbac-proxy" not found Jun 11 21:23:28.813251 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:28.813207 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:32.813201446 +0000 UTC m=+184.757738806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:29.316672 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:29.316638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:29.317029 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:29.316681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:29.317029 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:29.316797 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:29.317029 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:29.316865 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls podName:d0ef2266-ef72-4b79-9299-65aa62a1c548 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:37.316851269 +0000 UTC m=+189.261388629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-v2pm2" (UID: "d0ef2266-ef72-4b79-9299-65aa62a1c548") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:29.317029 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:29.316800 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:23:29.317029 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:29.316900 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b6ff49fdb-cpm2b: secret "image-registry-tls" not found Jun 11 21:23:29.317029 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:29.316941 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls podName:9d8ce527-2d34-4120-b0e9-25b1b011ce64 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:37.31693093 +0000 UTC m=+189.261468309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls") pod "image-registry-7b6ff49fdb-cpm2b" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64") : secret "image-registry-tls" not found Jun 11 21:23:29.597472 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:29.597385 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:31.656837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:31.656797 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:31.657258 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:31.656858 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:31.657258 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:31.657180 2563 scope.go:117] "RemoveContainer" containerID="5d857cf76dfaafaf0f0382814d6b6c1d378e25736aa263c939b83cd740b02d7e" Jun 11 21:23:31.657371 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:31.657358 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-kgtvc_openshift-console-operator(3dc7c258-a851-4895-bd3e-f15e41c9c45c)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" podUID="3dc7c258-a851-4895-bd3e-f15e41c9c45c" Jun 11 21:23:32.618525 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:32.618456 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:32.729388 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:32.729358 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:32.816026 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:32.815982 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:32.847720 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:32.847693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:32.847888 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:32.847739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:32.847888 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:32.847814 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:23:32.847952 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:32.847888 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:40.847867203 +0000 UTC m=+192.792404581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : configmap "kube-rbac-proxy" not found Jun 11 21:23:32.847952 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:32.847892 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:32.847952 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:32.847940 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:40.847928427 +0000 UTC m=+192.792465787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:32.916837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:32.916746 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:33.022048 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:33.022013 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:33.075152 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:33.075121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:33.740135 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:33.740105 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:34.145006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:34.144908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:34.340120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:34.340084 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:34.740702 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:34.740657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:35.340995 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:35.340955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:35.741660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:35.741623 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:35.942659 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:35.942618 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:36.043164 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:36.043074 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:36.454683 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:36.454580 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:36.555319 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:36.555266 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:36.607690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:36.607653 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:36.949880 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:36.949845 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:37.144899 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.144869 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:37.381121 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.381081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:37.381337 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.381130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:37.381337 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:37.381230 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:37.381337 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:37.381310 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls podName:d0ef2266-ef72-4b79-9299-65aa62a1c548 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:53.381295256 +0000 UTC m=+205.325832628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-v2pm2" (UID: "d0ef2266-ef72-4b79-9299-65aa62a1c548") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:23:37.383754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.383731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"image-registry-7b6ff49fdb-cpm2b\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:37.463759 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.463724 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xgf6c\"" Jun 11 21:23:37.471954 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.471928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:37.599145 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.599115 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b6ff49fdb-cpm2b"] Jun 11 21:23:37.602709 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:37.602682 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8ce527_2d34_4120_b0e9_25b1b011ce64.slice/crio-0529f0dfd23677648fd4a7ac2baab579d69f85c69bf30990366e019b077c0723 WatchSource:0}: Error finding container 0529f0dfd23677648fd4a7ac2baab579d69f85c69bf30990366e019b077c0723: Status 404 returned error can't find the container with id 0529f0dfd23677648fd4a7ac2baab579d69f85c69bf30990366e019b077c0723 Jun 11 21:23:37.758366 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:37.758330 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:38.111301 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.111241 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:38.114431 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.114406 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" event={"ID":"9d8ce527-2d34-4120-b0e9-25b1b011ce64","Type":"ContainerStarted","Data":"f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec"} Jun 11 21:23:38.114546 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.114451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" event={"ID":"9d8ce527-2d34-4120-b0e9-25b1b011ce64","Type":"ContainerStarted","Data":"0529f0dfd23677648fd4a7ac2baab579d69f85c69bf30990366e019b077c0723"} Jun 11 21:23:38.114546 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.114539 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:23:38.135817 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.135773 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" podStartSLOduration=17.135760204 podStartE2EDuration="17.135760204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:38.134647286 +0000 UTC m=+190.079184668" watchObservedRunningTime="2026-06-11 21:23:38.135760204 +0000 UTC m=+190.080297588" Jun 11 21:23:38.166899 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.166868 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:38.540606 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.540565 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:38.746900 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:38.746846 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:39.146710 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:39.146675 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:39.249049 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:39.249016 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:39.557142 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:39.557105 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.144329 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:40.144299 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.564230 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:40.564200 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.752522 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:40.752486 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.909311 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:40.909186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:40.909311 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:40.909245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:40.909540 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:40.909410 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:23:40.909540 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:40.909496 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls podName:f5369e28-ac8b-448d-8451-c10c33268f3b nodeName:}" failed. No retries permitted until 2026-06-11 21:23:56.909476886 +0000 UTC m=+208.854014250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t2w4f" (UID: "f5369e28-ac8b-448d-8451-c10c33268f3b") : secret "insights-runtime-extractor-tls" not found Jun 11 21:23:40.909766 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:40.909742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5369e28-ac8b-448d-8451-c10c33268f3b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:41.146243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:41.146191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:41.540484 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:41.540444 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:41.942572 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:41.942467 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:42.341778 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:42.341740 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:42.495404 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:42.495365 2563 scope.go:117] "RemoveContainer" containerID="5d857cf76dfaafaf0f0382814d6b6c1d378e25736aa263c939b83cd740b02d7e" Jun 11 21:23:42.982125 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:42.982089 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:43.130147 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.130120 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:23:43.130333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.130179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" event={"ID":"3dc7c258-a851-4895-bd3e-f15e41c9c45c","Type":"ContainerStarted","Data":"2e73c4821323b5c8d91296fcb7b163177c10e90c4b2a7bc0f87b981b3900a78a"} Jun 11 21:23:43.130514 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.130497 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:43.136485 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.136453 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:43.146478 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.146438 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" podStartSLOduration=19.526677648 podStartE2EDuration="22.146425903s" totalImagesPullingTime="2.619748255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:43.145619082 +0000 UTC m=+195.090156462" watchObservedRunningTime="2026-06-11 21:23:43.146425903 +0000 UTC m=+195.090963345" Jun 11 21:23:43.342383 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.342272 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:43.781771 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.781741 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-kgtvc" Jun 11 21:23:43.951070 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:43.951025 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:44.052373 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:44.052259 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:44.101250 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:44.101217 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:44.280400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:44.280359 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:44.634492 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:44.634450 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:45.040473 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:45.040438 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:45.258820 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:45.258781 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:45.309857 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:45.309761 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:45.640916 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:45.640831 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:45.842130 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:45.842093 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:46.425566 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:46.425528 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:47.268345 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.268311 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:47.718706 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.718675 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-8qftt"] Jun 11 21:23:47.721937 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.721917 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-8qftt" Jun 11 21:23:47.724874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.724851 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 21:23:47.725001 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.724900 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 21:23:47.725001 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.724855 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nl56b\"" Jun 11 21:23:47.732263 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.732239 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b6ff49fdb-cpm2b"] Jun 11 21:23:47.733260 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.733234 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-8qftt"] Jun 11 21:23:47.757618 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.757593 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67995499b6-lvdms"] Jun 11 21:23:47.760043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.760028 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.766175 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.766138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wss2v\" (UniqueName: \"kubernetes.io/projected/78daced3-a5ee-414b-9c56-6e62644fc24a-kube-api-access-wss2v\") pod \"downloads-694c955b9-8qftt\" (UID: \"78daced3-a5ee-414b-9c56-6e62644fc24a\") " pod="openshift-console/downloads-694c955b9-8qftt" Jun 11 21:23:47.778798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.778773 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67995499b6-lvdms"] Jun 11 21:23:47.818081 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.818045 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:47.866777 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866752 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wss2v\" (UniqueName: \"kubernetes.io/projected/78daced3-a5ee-414b-9c56-6e62644fc24a-kube-api-access-wss2v\") pod \"downloads-694c955b9-8qftt\" (UID: \"78daced3-a5ee-414b-9c56-6e62644fc24a\") " pod="openshift-console/downloads-694c955b9-8qftt" Jun 11 21:23:47.866908 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/130b62b1-9220-4d93-9349-85d0cc9ac8c4-trusted-ca\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.866908 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/130b62b1-9220-4d93-9349-85d0cc9ac8c4-image-registry-private-configuration\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.866908 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/130b62b1-9220-4d93-9349-85d0cc9ac8c4-installation-pull-secrets\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.867029 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-registry-tls\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.867029 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvpzc\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-kube-api-access-cvpzc\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.867029 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/130b62b1-9220-4d93-9349-85d0cc9ac8c4-registry-certificates\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.867029 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.866985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-bound-sa-token\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.867152 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.867035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/130b62b1-9220-4d93-9349-85d0cc9ac8c4-ca-trust-extracted\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.875923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.875900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wss2v\" (UniqueName: \"kubernetes.io/projected/78daced3-a5ee-414b-9c56-6e62644fc24a-kube-api-access-wss2v\") pod \"downloads-694c955b9-8qftt\" (UID: \"78daced3-a5ee-414b-9c56-6e62644fc24a\") " pod="openshift-console/downloads-694c955b9-8qftt" Jun 11 21:23:47.918242 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.918207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:47.967892 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.967866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/130b62b1-9220-4d93-9349-85d0cc9ac8c4-trusted-ca\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.968070 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.967900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/130b62b1-9220-4d93-9349-85d0cc9ac8c4-image-registry-private-configuration\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.968070 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.967927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/130b62b1-9220-4d93-9349-85d0cc9ac8c4-installation-pull-secrets\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.968185 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.968162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-registry-tls\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.968231 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.968197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvpzc\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-kube-api-access-cvpzc\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.968231 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.968223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/130b62b1-9220-4d93-9349-85d0cc9ac8c4-registry-certificates\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.968371 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.968350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-bound-sa-token\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.968422 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.968401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/130b62b1-9220-4d93-9349-85d0cc9ac8c4-ca-trust-extracted\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.969007 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.968798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/130b62b1-9220-4d93-9349-85d0cc9ac8c4-ca-trust-extracted\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.969201 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.969177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/130b62b1-9220-4d93-9349-85d0cc9ac8c4-registry-certificates\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.969496 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.969475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/130b62b1-9220-4d93-9349-85d0cc9ac8c4-trusted-ca\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.970557 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.970537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/130b62b1-9220-4d93-9349-85d0cc9ac8c4-image-registry-private-configuration\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.970924 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.970900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/130b62b1-9220-4d93-9349-85d0cc9ac8c4-installation-pull-secrets\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.971108 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.971090 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-registry-tls\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.975620 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.975596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-bound-sa-token\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:47.975853 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:47.975830 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvpzc\" (UniqueName: \"kubernetes.io/projected/130b62b1-9220-4d93-9349-85d0cc9ac8c4-kube-api-access-cvpzc\") pod \"image-registry-67995499b6-lvdms\" (UID: \"130b62b1-9220-4d93-9349-85d0cc9ac8c4\") " pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:48.031379 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:48.031357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-8qftt" Jun 11 21:23:48.069723 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:48.069691 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:48.180934 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:48.180809 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-8qftt"] Jun 11 21:23:48.183399 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:48.183365 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78daced3_a5ee_414b_9c56_6e62644fc24a.slice/crio-af0ffb2bea8f601a27366b6897aeda11545c63c28074e8f37bc4dbebb5c24c2c WatchSource:0}: Error finding container af0ffb2bea8f601a27366b6897aeda11545c63c28074e8f37bc4dbebb5c24c2c: Status 404 returned error can't find the container with id af0ffb2bea8f601a27366b6897aeda11545c63c28074e8f37bc4dbebb5c24c2c Jun 11 21:23:48.227322 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:48.227273 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67995499b6-lvdms"] Jun 11 21:23:48.229463 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:48.229427 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130b62b1_9220_4d93_9349_85d0cc9ac8c4.slice/crio-8a765d15ff62f339b8269ab19cbc310928b96250e78d7981909fe701dcacfa4d WatchSource:0}: Error finding container 8a765d15ff62f339b8269ab19cbc310928b96250e78d7981909fe701dcacfa4d: Status 404 returned error can't find the container with id 8a765d15ff62f339b8269ab19cbc310928b96250e78d7981909fe701dcacfa4d Jun 11 21:23:49.154394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:49.154352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-8qftt" event={"ID":"78daced3-a5ee-414b-9c56-6e62644fc24a","Type":"ContainerStarted","Data":"af0ffb2bea8f601a27366b6897aeda11545c63c28074e8f37bc4dbebb5c24c2c"} Jun 11 21:23:49.156019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:49.155987 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67995499b6-lvdms" event={"ID":"130b62b1-9220-4d93-9349-85d0cc9ac8c4","Type":"ContainerStarted","Data":"56d225be8b7531dbf8993c0483ba57336b1c7fc77295c7f0b32ba3b8a0fce811"} Jun 11 21:23:49.156156 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:49.156032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67995499b6-lvdms" event={"ID":"130b62b1-9220-4d93-9349-85d0cc9ac8c4","Type":"ContainerStarted","Data":"8a765d15ff62f339b8269ab19cbc310928b96250e78d7981909fe701dcacfa4d"} Jun 11 21:23:49.156156 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:49.156149 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:23:49.175711 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:49.175658 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podStartSLOduration=2.175638007 podStartE2EDuration="2.175638007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:49.174874757 +0000 UTC m=+201.119412141" watchObservedRunningTime="2026-06-11 21:23:49.175638007 +0000 UTC m=+201.120175389" Jun 11 21:23:50.256941 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:50.256908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:50.310748 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:50.310712 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:53.415385 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:53.415342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:53.417897 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:53.417867 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0ef2266-ef72-4b79-9299-65aa62a1c548-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-v2pm2\" (UID: \"d0ef2266-ef72-4b79-9299-65aa62a1c548\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:53.657524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:53.657493 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hbppw\"" Jun 11 21:23:53.665518 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:53.665448 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" Jun 11 21:23:53.808920 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:53.808792 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2"] Jun 11 21:23:53.811831 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:53.811790 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ef2266_ef72_4b79_9299_65aa62a1c548.slice/crio-fdb0f5f0620fe3e373620ae134bcfb88ff96cd39f67d439d467211be7d931383 WatchSource:0}: Error finding container fdb0f5f0620fe3e373620ae134bcfb88ff96cd39f67d439d467211be7d931383: Status 404 returned error can't find the container with id fdb0f5f0620fe3e373620ae134bcfb88ff96cd39f67d439d467211be7d931383 Jun 11 21:23:54.176061 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:54.176021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" event={"ID":"d0ef2266-ef72-4b79-9299-65aa62a1c548","Type":"ContainerStarted","Data":"fdb0f5f0620fe3e373620ae134bcfb88ff96cd39f67d439d467211be7d931383"} Jun 11 21:23:55.427072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:55.427033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:55.485824 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:55.485773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:55.541274 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:55.541237 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:56.144039 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.143933 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:56.184533 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.184494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" event={"ID":"d0ef2266-ef72-4b79-9299-65aa62a1c548","Type":"ContainerStarted","Data":"3a430390307f6a43ca66a48fd6dcb9ad5f130818c88f2e6a8330171a46164207"} Jun 11 21:23:56.200360 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.200275 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-v2pm2" podStartSLOduration=33.190566365 podStartE2EDuration="35.200254215s" totalImagesPullingTime="2.00968785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:56.198764837 +0000 UTC m=+208.143302218" watchObservedRunningTime="2026-06-11 21:23:56.200254215 +0000 UTC m=+208.144791600" Jun 11 21:23:56.203790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.203722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:56.295909 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.295858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:56.501078 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.501044 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:56.674636 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.674598 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:56.757687 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.757598 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:56.948255 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.948216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:56.951055 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:56.951027 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5369e28-ac8b-448d-8451-c10c33268f3b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t2w4f\" (UID: \"f5369e28-ac8b-448d-8451-c10c33268f3b\") " pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:57.108114 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:57.108034 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tnblg\"" Jun 11 21:23:57.116665 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:57.116632 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t2w4f" Jun 11 21:23:57.268135 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:57.268108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t2w4f"] Jun 11 21:23:57.270345 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:23:57.270319 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5369e28_ac8b_448d_8451_c10c33268f3b.slice/crio-a7cd6cf1402382ca6c7e0af8773b8d28636c6c3ae1756762741b7c9ff95fa41f WatchSource:0}: Error finding container a7cd6cf1402382ca6c7e0af8773b8d28636c6c3ae1756762741b7c9ff95fa41f: Status 404 returned error can't find the container with id a7cd6cf1402382ca6c7e0af8773b8d28636c6c3ae1756762741b7c9ff95fa41f Jun 11 21:23:57.737442 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:57.737409 2563 patch_prober.go:28] interesting pod/image-registry-7b6ff49fdb-cpm2b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:23:57.737827 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:57.737463 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" podUID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:23:58.195752 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:58.195665 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2w4f" event={"ID":"f5369e28-ac8b-448d-8451-c10c33268f3b","Type":"ContainerStarted","Data":"a7cd6cf1402382ca6c7e0af8773b8d28636c6c3ae1756762741b7c9ff95fa41f"} Jun 11 21:23:58.476584 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:58.476534 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:58.571981 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:58.571941 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:59.328000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.327959 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:59.365113 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.365075 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd"] Jun 11 21:23:59.376035 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.376005 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.382332 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.378441 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd"] Jun 11 21:23:59.382332 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.379544 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 21:23:59.382332 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.380050 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-22vbz\"" Jun 11 21:23:59.382332 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.380793 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 21:23:59.383809 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.383785 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 21:23:59.399087 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.399055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:59.469564 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.469531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.469772 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.469589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.469772 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.469608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/329fad02-4580-46c7-be29-9c12d06e491a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.469772 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.469655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfpr8\" (UniqueName: \"kubernetes.io/projected/329fad02-4580-46c7-be29-9c12d06e491a-kube-api-access-tfpr8\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.570316 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.570262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.570497 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.570346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.570497 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.570379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/329fad02-4580-46c7-be29-9c12d06e491a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.570497 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:59.570403 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 21:23:59.570497 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.570420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfpr8\" (UniqueName: \"kubernetes.io/projected/329fad02-4580-46c7-be29-9c12d06e491a-kube-api-access-tfpr8\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.570497 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:23:59.570477 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-tls podName:329fad02-4580-46c7-be29-9c12d06e491a nodeName:}" failed. No retries permitted until 2026-06-11 21:24:00.070457184 +0000 UTC m=+212.014994545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-45tgd" (UID: "329fad02-4580-46c7-be29-9c12d06e491a") : secret "prometheus-operator-tls" not found Jun 11 21:23:59.571196 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.571155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/329fad02-4580-46c7-be29-9c12d06e491a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.573517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.573472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.579631 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.579549 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfpr8\" (UniqueName: \"kubernetes.io/projected/329fad02-4580-46c7-be29-9c12d06e491a-kube-api-access-tfpr8\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:23:59.715693 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.715649 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:59.816543 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:23:59.816492 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:00.074695 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:00.074664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:24:00.077485 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:00.077452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329fad02-4580-46c7-be29-9c12d06e491a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-45tgd\" (UID: \"329fad02-4580-46c7-be29-9c12d06e491a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:24:00.294531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:00.294490 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" Jun 11 21:24:01.408880 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:01.408836 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd"] Jun 11 21:24:01.863114 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:01.863077 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:01.912979 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:01.912938 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:02.212770 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:02.212737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2w4f" event={"ID":"f5369e28-ac8b-448d-8451-c10c33268f3b","Type":"ContainerStarted","Data":"563513b7b0af9ecd7267f4bf20efef3f95eefc77f4932bc6fe5a8d15a1ce8037"} Jun 11 21:24:03.266769 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:03.266730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:03.317044 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:03.317000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:06.261983 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:06.261940 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:06.319530 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:06.319484 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:07.737856 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:07.737817 2563 patch_prober.go:28] interesting pod/image-registry-7b6ff49fdb-cpm2b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:07.738274 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:07.737890 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" podUID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:08.074953 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:08.074871 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:08.074953 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:08.074934 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:08.392114 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:24:08.392041 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329fad02_4580_46c7_be29_9c12d06e491a.slice/crio-ca49e818c33c97bb834150a09d189a4ad28e8cf94cd17828d7a391b5d2eb8088 WatchSource:0}: Error finding container ca49e818c33c97bb834150a09d189a4ad28e8cf94cd17828d7a391b5d2eb8088: Status 404 returned error can't find the container with id ca49e818c33c97bb834150a09d189a4ad28e8cf94cd17828d7a391b5d2eb8088 Jun 11 21:24:09.242646 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:09.242600 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2w4f" event={"ID":"f5369e28-ac8b-448d-8451-c10c33268f3b","Type":"ContainerStarted","Data":"dbb177ba33bc7854181b0503ef83d2d0ffebfce87dac4942a6d2fd29488bd87c"} Jun 11 21:24:09.244832 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:09.244795 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" event={"ID":"329fad02-4580-46c7-be29-9c12d06e491a","Type":"ContainerStarted","Data":"ca49e818c33c97bb834150a09d189a4ad28e8cf94cd17828d7a391b5d2eb8088"} Jun 11 21:24:09.247497 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:09.247466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-8qftt" event={"ID":"78daced3-a5ee-414b-9c56-6e62644fc24a","Type":"ContainerStarted","Data":"e673c96d6ad69e78101a067f57073102f58ebe6581c8a3f143e73c35df6045e6"} Jun 11 21:24:09.248361 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:09.248343 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-8qftt" Jun 11 21:24:09.260085 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:09.260033 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-8qftt" Jun 11 21:24:09.265510 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:09.265459 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-8qftt" podStartSLOduration=1.972095081 podStartE2EDuration="22.265440278s" totalImagesPullingTime="20.293345197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:09.264646799 +0000 UTC m=+221.209184182" watchObservedRunningTime="2026-06-11 21:24:09.265440278 +0000 UTC m=+221.209977659" Jun 11 21:24:10.166910 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:10.166863 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:10.167134 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:10.166952 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:10.258240 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:10.258079 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" event={"ID":"329fad02-4580-46c7-be29-9c12d06e491a","Type":"ContainerStarted","Data":"a34a0887fcb289cf14844504b8bd9705e24b31ad440aa9eff35af2597840f136"} Jun 11 21:24:10.319146 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:10.319055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:11.267136 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:11.267058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" event={"ID":"329fad02-4580-46c7-be29-9c12d06e491a","Type":"ContainerStarted","Data":"1901efa9b0dbfa108662ddf5ea5c84a3ed06eb6ef65c93b994a4959feb93350f"} Jun 11 21:24:12.273607 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.273556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t2w4f" event={"ID":"f5369e28-ac8b-448d-8451-c10c33268f3b","Type":"ContainerStarted","Data":"33fba6fe6f94a91b9d37e6fe823d27aef4c309df2b2f14396e35db6fe49c588d"} Jun 11 21:24:12.290863 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.290805 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-45tgd" podStartSLOduration=11.697113595 podStartE2EDuration="13.290785383s" totalImagesPullingTime="1.593671788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:11.290401859 +0000 UTC m=+223.234939240" watchObservedRunningTime="2026-06-11 21:24:12.290785383 +0000 UTC m=+224.235322764" Jun 11 21:24:12.291675 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.291636 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t2w4f" podStartSLOduration=34.278871696 podStartE2EDuration="48.291626422s" totalImagesPullingTime="14.012754726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:23:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:12.28989259 +0000 UTC m=+224.234429983" watchObservedRunningTime="2026-06-11 21:24:12.291626422 +0000 UTC m=+224.236163803" Jun 11 21:24:12.517049 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.516979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:12.688132 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.688045 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:12.751757 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.751718 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hg77h"] Jun 11 21:24:12.753776 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.753739 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" podUID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" containerName="registry" containerID="cri-o://f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec" gracePeriod=30 Jun 11 21:24:12.785002 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.784967 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:12.789189 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.789161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.791868 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.791825 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 21:24:12.791868 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.791859 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 21:24:12.792055 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.791948 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 21:24:12.792221 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.792197 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xfs52\"" Jun 11 21:24:12.850593 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.850551 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:12.891965 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.891927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-textfile\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.891979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqtbp\" (UniqueName: \"kubernetes.io/projected/a6f7d374-c34e-482e-a663-fcce8f1c7217-kube-api-access-kqtbp\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.892016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6f7d374-c34e-482e-a663-fcce8f1c7217-metrics-client-ca\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.892036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-tls\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.892057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.892084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-sys\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.892163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-root\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.892217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.892400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.892250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-wtmp\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.950718 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.950627 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:12.993575 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.993790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-wtmp\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.993790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-textfile\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.993790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqtbp\" (UniqueName: \"kubernetes.io/projected/a6f7d374-c34e-482e-a663-fcce8f1c7217-kube-api-access-kqtbp\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.993790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6f7d374-c34e-482e-a663-fcce8f1c7217-metrics-client-ca\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.993790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-tls\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.993790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993771 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-wtmp\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994114 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.994102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-textfile\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994232 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.994201 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994232 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.993783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994869 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.994625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-sys\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994869 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.994699 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6f7d374-c34e-482e-a663-fcce8f1c7217-metrics-client-ca\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994869 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.994706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-root\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994869 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.994760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-sys\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.994869 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.994806 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a6f7d374-c34e-482e-a663-fcce8f1c7217-root\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.997340 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.997273 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-tls\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:12.997340 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:12.997332 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6f7d374-c34e-482e-a663-fcce8f1c7217-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:13.002451 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.002396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqtbp\" (UniqueName: \"kubernetes.io/projected/a6f7d374-c34e-482e-a663-fcce8f1c7217-kube-api-access-kqtbp\") pod \"node-exporter-hg77h\" (UID: \"a6f7d374-c34e-482e-a663-fcce8f1c7217\") " pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:13.047798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.047759 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:13.048165 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.048135 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:24:13.145052 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.145019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hg77h" Jun 11 21:24:13.148182 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.148148 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:13.170473 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:24:13.170438 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6f7d374_c34e_482e_a663_fcce8f1c7217.slice/crio-e0cb90333b3b5b356ea292eb3065b35004ee729572b200271ad5b942188b169d WatchSource:0}: Error finding container e0cb90333b3b5b356ea292eb3065b35004ee729572b200271ad5b942188b169d: Status 404 returned error can't find the container with id e0cb90333b3b5b356ea292eb3065b35004ee729572b200271ad5b942188b169d Jun 11 21:24:13.196578 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196496 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrrtp\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-kube-api-access-mrrtp\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.196578 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196541 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-installation-pull-secrets\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.196578 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196560 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d8ce527-2d34-4120-b0e9-25b1b011ce64-ca-trust-extracted\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.196974 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196598 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.196974 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196777 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-certificates\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.196974 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196847 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-image-registry-private-configuration\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.196974 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196897 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-bound-sa-token\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.196974 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.196926 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-trusted-ca\") pod \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\" (UID: \"9d8ce527-2d34-4120-b0e9-25b1b011ce64\") " Jun 11 21:24:13.197229 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.197190 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:24:13.197610 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.197497 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:24:13.199837 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.199811 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-kube-api-access-mrrtp" (OuterVolumeSpecName: "kube-api-access-mrrtp") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "kube-api-access-mrrtp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:24:13.201043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.201019 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:24:13.201151 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.201080 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:24:13.201310 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.201269 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:24:13.201433 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.201321 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:24:13.209489 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.209467 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d8ce527-2d34-4120-b0e9-25b1b011ce64-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9d8ce527-2d34-4120-b0e9-25b1b011ce64" (UID: "9d8ce527-2d34-4120-b0e9-25b1b011ce64"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:24:13.223006 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.222972 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:13.284852 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.284812 2563 generic.go:356] "Generic (PLEG): container finished" podID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" containerID="f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec" exitCode=0 Jun 11 21:24:13.285386 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.284877 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" Jun 11 21:24:13.285386 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.284901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" event={"ID":"9d8ce527-2d34-4120-b0e9-25b1b011ce64","Type":"ContainerDied","Data":"f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec"} Jun 11 21:24:13.285386 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.284987 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b6ff49fdb-cpm2b" event={"ID":"9d8ce527-2d34-4120-b0e9-25b1b011ce64","Type":"ContainerDied","Data":"0529f0dfd23677648fd4a7ac2baab579d69f85c69bf30990366e019b077c0723"} Jun 11 21:24:13.285386 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.285014 2563 scope.go:117] "RemoveContainer" containerID="f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec" Jun 11 21:24:13.287513 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.287426 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg77h" event={"ID":"a6f7d374-c34e-482e-a663-fcce8f1c7217","Type":"ContainerStarted","Data":"e0cb90333b3b5b356ea292eb3065b35004ee729572b200271ad5b942188b169d"} Jun 11 21:24:13.297835 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297808 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrrtp\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-kube-api-access-mrrtp\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.297835 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297833 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-installation-pull-secrets\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.297999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297849 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d8ce527-2d34-4120-b0e9-25b1b011ce64-ca-trust-extracted\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.297999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297861 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.297999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297869 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-registry-certificates\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.297999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297878 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d8ce527-2d34-4120-b0e9-25b1b011ce64-image-registry-private-configuration\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.297999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297887 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d8ce527-2d34-4120-b0e9-25b1b011ce64-bound-sa-token\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.297999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.297899 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d8ce527-2d34-4120-b0e9-25b1b011ce64-trusted-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:24:13.298688 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.298666 2563 scope.go:117] "RemoveContainer" containerID="f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec" Jun 11 21:24:13.298999 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:24:13.298972 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec\": container with ID starting with f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec not found: ID does not exist" containerID="f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec" Jun 11 21:24:13.299082 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.299009 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec"} err="failed to get container status \"f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec\": rpc error: code = NotFound desc = could not find container \"f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec\": container with ID starting with f0140e1c2b5ea6191a353632c837047f127c30126f2293a075fc759d04cf94ec not found: ID does not exist" Jun 11 21:24:13.309640 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.309611 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b6ff49fdb-cpm2b"] Jun 11 21:24:13.313467 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.313445 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b6ff49fdb-cpm2b"] Jun 11 21:24:13.363260 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.363230 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:13.701304 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.696093 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:13.778304 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.777882 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:13.783243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.782555 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:24:13.783243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.782984 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" containerName="registry" Jun 11 21:24:13.783243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.783003 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" containerName="registry" Jun 11 21:24:13.783243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.783093 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" containerName="registry" Jun 11 21:24:13.817811 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.817776 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:24:13.817996 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.817977 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.822702 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.822673 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 21:24:13.822942 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.822923 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 21:24:13.823493 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.823471 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 21:24:13.826559 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.826535 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ljkbd\"" Jun 11 21:24:13.826777 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.826757 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 21:24:13.826958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.826941 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 21:24:13.827123 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.827110 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 21:24:13.827233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.827219 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 21:24:13.827309 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.827256 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 21:24:13.827366 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.827352 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 21:24:13.911189 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-web-config\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911189 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911460 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911460 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911460 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhbvh\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-kube-api-access-rhbvh\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911460 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-out\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911827 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911827 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:13.911827 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:13.911731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.003019 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.002977 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:14.012996 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.012956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.013197 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.013015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-out\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.013197 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.013044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.013197 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.013079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014030 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014373 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.013130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014487 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014487 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014487 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014651 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-web-config\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014651 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014651 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014802 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.014862 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.014820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhbvh\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-kube-api-access-rhbvh\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.017074 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.016825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.017074 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.016845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.020259 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.019382 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-web-config\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.023867 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.022664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.023867 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.023224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.023867 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.023817 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.024688 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.024664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.024800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.024769 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.027996 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.027431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.027996 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.027962 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhbvh\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-kube-api-access-rhbvh\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.028991 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.028937 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-out\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.031084 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.031020 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.134572 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.134531 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:24:14.423316 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.422650 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:24:14.500668 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:14.500627 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d8ce527-2d34-4120-b0e9-25b1b011ce64" path="/var/lib/kubelet/pods/9d8ce527-2d34-4120-b0e9-25b1b011ce64/volumes" Jun 11 21:24:14.555831 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:24:14.555733 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61244c3c_4ac5_45eb_93d3_2cab4eeb07bf.slice/crio-48b9a206279ced63528813b05eb440811f3da89bbcfa2e62ddcfc3640774f49b WatchSource:0}: Error finding container 48b9a206279ced63528813b05eb440811f3da89bbcfa2e62ddcfc3640774f49b: Status 404 returned error can't find the container with id 48b9a206279ced63528813b05eb440811f3da89bbcfa2e62ddcfc3640774f49b Jun 11 21:24:15.119526 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:15.119416 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:15.300184 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:15.300145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerStarted","Data":"48b9a206279ced63528813b05eb440811f3da89bbcfa2e62ddcfc3640774f49b"} Jun 11 21:24:15.302794 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:15.302762 2563 generic.go:356] "Generic (PLEG): container finished" podID="a6f7d374-c34e-482e-a663-fcce8f1c7217" containerID="a55ab425da785edee71e3f7f9c767be5de8101e8ae1c8e1a1368c3bd1f399ec0" exitCode=0 Jun 11 21:24:15.302943 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:15.302810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg77h" event={"ID":"a6f7d374-c34e-482e-a663-fcce8f1c7217","Type":"ContainerDied","Data":"a55ab425da785edee71e3f7f9c767be5de8101e8ae1c8e1a1368c3bd1f399ec0"} Jun 11 21:24:15.677028 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:15.676921 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:15.777570 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:15.777540 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:15.876715 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:15.876681 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:16.032353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:16.032312 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:16.310323 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:16.310258 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg77h" event={"ID":"a6f7d374-c34e-482e-a663-fcce8f1c7217","Type":"ContainerStarted","Data":"96794d9996fb1be935dfda3400351fae29ec6b697b0842bf8efe9f4563c68f86"} Jun 11 21:24:16.310475 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:16.310390 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg77h" event={"ID":"a6f7d374-c34e-482e-a663-fcce8f1c7217","Type":"ContainerStarted","Data":"8104bbcfa208b6be5f92b7ee666f2a4bf553c09113bf46301d64879b4145005b"} Jun 11 21:24:16.329027 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:16.328974 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hg77h" podStartSLOduration=2.79236278 podStartE2EDuration="4.328952195s" totalImagesPullingTime="1.412641523s" totalInitContainerRuntime="123.947892ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:16.327478005 +0000 UTC m=+228.272015411" watchObservedRunningTime="2026-06-11 21:24:16.328952195 +0000 UTC m=+228.273489577" Jun 11 21:24:17.115262 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.115226 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr"] Jun 11 21:24:17.138325 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.138266 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr"] Jun 11 21:24:17.138493 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.138388 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.143099 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.142399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 21:24:17.143099 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.142794 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 21:24:17.143329 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.143113 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 21:24:17.143329 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.143147 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d00mnof2ejgjm\"" Jun 11 21:24:17.143445 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.143405 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 21:24:17.143779 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.143739 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5pphr\"" Jun 11 21:24:17.243508 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.243467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d03359c3-0049-4acd-93c5-8fc560887498-audit-log\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.243679 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.243527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d03359c3-0049-4acd-93c5-8fc560887498-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.243679 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.243627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-secret-metrics-server-tls\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.243679 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.243675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d03359c3-0049-4acd-93c5-8fc560887498-metrics-server-audit-profiles\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.243829 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.243712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-secret-metrics-server-client-certs\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.243829 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.243735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pf8\" (UniqueName: \"kubernetes.io/projected/d03359c3-0049-4acd-93c5-8fc560887498-kube-api-access-56pf8\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.243829 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.243773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-client-ca-bundle\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.317993 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.317951 2563 generic.go:356] "Generic (PLEG): container finished" podID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerID="4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b" exitCode=0 Jun 11 21:24:17.318175 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.318042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b"} Jun 11 21:24:17.344875 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.344842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d03359c3-0049-4acd-93c5-8fc560887498-audit-log\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.344903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d03359c3-0049-4acd-93c5-8fc560887498-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.344983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-secret-metrics-server-tls\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.345063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d03359c3-0049-4acd-93c5-8fc560887498-metrics-server-audit-profiles\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345247 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.345143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-secret-metrics-server-client-certs\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345247 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.345169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56pf8\" (UniqueName: \"kubernetes.io/projected/d03359c3-0049-4acd-93c5-8fc560887498-kube-api-access-56pf8\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345387 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.345275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d03359c3-0049-4acd-93c5-8fc560887498-audit-log\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345387 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.345340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-client-ca-bundle\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.345747 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.345721 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d03359c3-0049-4acd-93c5-8fc560887498-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.346605 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.346579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d03359c3-0049-4acd-93c5-8fc560887498-metrics-server-audit-profiles\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.348684 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.348656 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-client-ca-bundle\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.349253 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.349154 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-secret-metrics-server-tls\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.349253 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.349226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d03359c3-0049-4acd-93c5-8fc560887498-secret-metrics-server-client-certs\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.358229 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.358202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pf8\" (UniqueName: \"kubernetes.io/projected/d03359c3-0049-4acd-93c5-8fc560887498-kube-api-access-56pf8\") pod \"metrics-server-7df7d5c7cd-f9qmr\" (UID: \"d03359c3-0049-4acd-93c5-8fc560887498\") " pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.450518 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.450429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:17.500712 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.500674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:17.570232 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.570180 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:17.647209 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.647173 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr"] Jun 11 21:24:17.651486 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:24:17.651453 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03359c3_0049_4acd_93c5_8fc560887498.slice/crio-85d998a57ef00cc1a08d3b86ced9f44b7bc91a7b665bb0ea45ed5e79e117fc6e WatchSource:0}: Error finding container 85d998a57ef00cc1a08d3b86ced9f44b7bc91a7b665bb0ea45ed5e79e117fc6e: Status 404 returned error can't find the container with id 85d998a57ef00cc1a08d3b86ced9f44b7bc91a7b665bb0ea45ed5e79e117fc6e Jun 11 21:24:17.767524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:17.767443 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:18.075394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.075308 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:18.075394 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.075374 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:18.324897 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.324861 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" event={"ID":"d03359c3-0049-4acd-93c5-8fc560887498","Type":"ContainerStarted","Data":"85d998a57ef00cc1a08d3b86ced9f44b7bc91a7b665bb0ea45ed5e79e117fc6e"} Jun 11 21:24:18.939767 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.939661 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:18.941421 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.941342 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:24:18.967584 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.967551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:24:18.967764 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.967704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:18.970683 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.970367 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 21:24:18.970683 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.970527 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.971046 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.971243 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.971497 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.971705 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6dbm\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.972235 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.972452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.972722 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.972941 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.973116 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.973421 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.974451 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7qrnh448du5va\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.974493 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 21:24:18.974703 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.974574 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 21:24:18.976809 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:18.976778 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 21:24:19.064665 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.064665 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.064941 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.064941 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.064941 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.064941 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.064941 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-web-config\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.064988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-config-out\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txxf9\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-kube-api-access-txxf9\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-config\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.065482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.065415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.166750 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.166951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.166951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.166951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.166951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.166951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txxf9\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-kube-api-access-txxf9\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-config\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.166998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-web-config\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167844 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167844 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-config-out\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.167844 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167451 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.168053 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.167948 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.168178 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.168156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.168595 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.168564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.168717 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.168673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.168980 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.168953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.170186 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.169857 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.171923 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.171897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-web-config\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.173699 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.173670 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.175673 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.175626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.177066 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.176264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.177066 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.176374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.177066 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.176591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.177066 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.176833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.177066 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.177006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.177066 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.177019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-config-out\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.178388 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.177474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-config\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.178388 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.177996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.178861 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.178837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txxf9\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-kube-api-access-txxf9\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.179456 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.179435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:19.283810 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:19.283767 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:20.163828 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:20.163791 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:20.164215 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:20.163849 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:20.317589 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:20.317524 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:24:20.319537 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:24:20.319493 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf93b3a_4291_428e_8905_11d37f65c894.slice/crio-5e0577094ad8817aa6ffe77d78d0326d770d0deec9a944fd178987bf3517f1f6 WatchSource:0}: Error finding container 5e0577094ad8817aa6ffe77d78d0326d770d0deec9a944fd178987bf3517f1f6: Status 404 returned error can't find the container with id 5e0577094ad8817aa6ffe77d78d0326d770d0deec9a944fd178987bf3517f1f6 Jun 11 21:24:20.338999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:20.338960 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerStarted","Data":"5e0577094ad8817aa6ffe77d78d0326d770d0deec9a944fd178987bf3517f1f6"} Jun 11 21:24:20.341000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:20.340975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerStarted","Data":"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0"} Jun 11 21:24:20.342921 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:20.342893 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" event={"ID":"d03359c3-0049-4acd-93c5-8fc560887498","Type":"ContainerStarted","Data":"fba25b9808173090e90b2e99e889805d0bc9690429f45f919363b1ac2bf0b028"} Jun 11 21:24:20.393640 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:20.393468 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" podStartSLOduration=0.87152006 podStartE2EDuration="3.393446601s" totalImagesPullingTime="2.521926541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:20.39043833 +0000 UTC m=+232.334975712" watchObservedRunningTime="2026-06-11 21:24:20.393446601 +0000 UTC m=+232.337983984" Jun 11 21:24:21.349002 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:21.348965 2563 generic.go:356] "Generic (PLEG): container finished" podID="8cf93b3a-4291-428e-8905-11d37f65c894" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" exitCode=0 Jun 11 21:24:21.349620 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:21.349045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2"} Jun 11 21:24:21.353328 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:21.353295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerStarted","Data":"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0"} Jun 11 21:24:21.353418 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:21.353397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerStarted","Data":"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407"} Jun 11 21:24:21.353457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:21.353446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerStarted","Data":"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83"} Jun 11 21:24:21.353511 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:21.353496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerStarted","Data":"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb"} Jun 11 21:24:22.362611 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:22.362569 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerStarted","Data":"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456"} Jun 11 21:24:22.391453 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:22.391391 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.806162472 podStartE2EDuration="9.391368368s" totalImagesPullingTime="5.566134603s" totalInitContainerRuntime="19.071293ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:22.388596063 +0000 UTC m=+234.333133446" watchObservedRunningTime="2026-06-11 21:24:22.391368368 +0000 UTC m=+234.335905751" Jun 11 21:24:24.464115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:24.464070 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:25.114818 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:25.114778 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:25.216365 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:25.216334 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:25.385177 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:25.385132 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerStarted","Data":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} Jun 11 21:24:25.385400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:25.385378 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerStarted","Data":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} Jun 11 21:24:26.035679 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:26.035636 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:26.134489 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:26.134454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:28.074790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.074764 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:28.075095 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.074806 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:28.075095 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.074840 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:24:28.096755 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.096731 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"56d225be8b7531dbf8993c0483ba57336b1c7fc77295c7f0b32ba3b8a0fce811"} pod="openshift-image-registry/image-registry-67995499b6-lvdms" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 21:24:28.101782 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.101758 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:28.101920 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.101797 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:28.401167 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.401130 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerStarted","Data":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} Jun 11 21:24:28.401334 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.401199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerStarted","Data":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} Jun 11 21:24:28.401334 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:28.401227 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerStarted","Data":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} Jun 11 21:24:29.408495 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:29.408457 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerStarted","Data":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} Jun 11 21:24:29.436755 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:29.436698 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.963277604 podStartE2EDuration="11.436679995s" totalImagesPullingTime="6.453976146s" totalInitContainerRuntime="19.426245ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:29.434204054 +0000 UTC m=+241.378741449" watchObservedRunningTime="2026-06-11 21:24:29.436679995 +0000 UTC m=+241.381217416" Jun 11 21:24:32.170582 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:32.170548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/init-config-reloader/0.log" Jun 11 21:24:32.369662 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:32.369631 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/alertmanager/0.log" Jun 11 21:24:32.569587 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:32.569561 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/config-reloader/0.log" Jun 11 21:24:32.769470 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:32.769431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/kube-rbac-proxy-web/0.log" Jun 11 21:24:32.970223 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:32.970191 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/kube-rbac-proxy/0.log" Jun 11 21:24:33.169767 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:33.169733 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/kube-rbac-proxy-metric/0.log" Jun 11 21:24:33.369892 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:33.369804 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/prom-label-proxy/0.log" Jun 11 21:24:33.572955 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:33.572923 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-v2pm2_d0ef2266-ef72-4b79-9299-65aa62a1c548/cluster-monitoring-operator/0.log" Jun 11 21:24:34.275824 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:34.275783 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:34.284179 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:34.284155 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:24:34.340501 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:34.340471 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:34.370629 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:34.370599 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7df7d5c7cd-f9qmr_d03359c3-0049-4acd-93c5-8fc560887498/metrics-server/0.log" Jun 11 21:24:35.370486 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:35.370457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg77h_a6f7d374-c34e-482e-a663-fcce8f1c7217/init-textfile/0.log" Jun 11 21:24:35.571682 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:35.571650 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg77h_a6f7d374-c34e-482e-a663-fcce8f1c7217/node-exporter/0.log" Jun 11 21:24:35.769907 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:35.769879 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg77h_a6f7d374-c34e-482e-a663-fcce8f1c7217/kube-rbac-proxy/0.log" Jun 11 21:24:37.170398 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:37.170371 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8cf93b3a-4291-428e-8905-11d37f65c894/init-config-reloader/0.log" Jun 11 21:24:37.371125 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:37.371091 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8cf93b3a-4291-428e-8905-11d37f65c894/prometheus/0.log" Jun 11 21:24:37.450645 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:37.450559 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:37.450645 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:37.450639 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:37.569876 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:37.569847 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8cf93b3a-4291-428e-8905-11d37f65c894/config-reloader/0.log" Jun 11 21:24:37.769914 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:37.769878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8cf93b3a-4291-428e-8905-11d37f65c894/thanos-sidecar/0.log" Jun 11 21:24:37.970024 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:37.969986 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8cf93b3a-4291-428e-8905-11d37f65c894/kube-rbac-proxy-web/0.log" Jun 11 21:24:38.101091 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:38.101003 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:38.101091 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:38.101061 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:38.169588 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:38.169548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8cf93b3a-4291-428e-8905-11d37f65c894/kube-rbac-proxy/0.log" Jun 11 21:24:38.369723 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:38.369629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8cf93b3a-4291-428e-8905-11d37f65c894/kube-rbac-proxy-thanos/0.log" Jun 11 21:24:38.572670 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:38.572639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-45tgd_329fad02-4580-46c7-be29-9c12d06e491a/prometheus-operator/0.log" Jun 11 21:24:38.771136 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:38.771105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-45tgd_329fad02-4580-46c7-be29-9c12d06e491a/kube-rbac-proxy/0.log" Jun 11 21:24:40.269588 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.269550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:24:40.272036 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.272015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd92ef1c-51b4-4a53-bcb4-3e1901dbe949-metrics-certs\") pod \"network-metrics-daemon-pzdps\" (UID: \"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949\") " pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:24:40.452110 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.452019 2563 generic.go:356] "Generic (PLEG): container finished" podID="861761bd-5375-43e3-8e04-50b0485ebb9c" containerID="b66d20100f5b9877fb261982da270a7de876b4f64b3bedbadaf725908a6381dd" exitCode=0 Jun 11 21:24:40.452110 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.452085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" event={"ID":"861761bd-5375-43e3-8e04-50b0485ebb9c","Type":"ContainerDied","Data":"b66d20100f5b9877fb261982da270a7de876b4f64b3bedbadaf725908a6381dd"} Jun 11 21:24:40.452419 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.452406 2563 scope.go:117] "RemoveContainer" containerID="b66d20100f5b9877fb261982da270a7de876b4f64b3bedbadaf725908a6381dd" Jun 11 21:24:40.498794 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.498768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l7p7b\"" Jun 11 21:24:40.506869 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.506841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pzdps" Jun 11 21:24:40.571128 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.571046 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:24:40.653733 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.653707 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pzdps"] Jun 11 21:24:40.655673 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:24:40.655646 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd92ef1c_51b4_4a53_bcb4_3e1901dbe949.slice/crio-e7f853985dad8dc5331f46c4316f2ed09df5f6672abd91c01c2c4fc00382e1dc WatchSource:0}: Error finding container e7f853985dad8dc5331f46c4316f2ed09df5f6672abd91c01c2c4fc00382e1dc: Status 404 returned error can't find the container with id e7f853985dad8dc5331f46c4316f2ed09df5f6672abd91c01c2c4fc00382e1dc Jun 11 21:24:40.772989 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:40.772948 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/2.log" Jun 11 21:24:41.459540 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:41.459485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-wwcdw" event={"ID":"861761bd-5375-43e3-8e04-50b0485ebb9c","Type":"ContainerStarted","Data":"a15fcc89d1f67d0017cb9150608a28ff67ee9083d3d3eac2f5163a2af123e0f6"} Jun 11 21:24:41.460854 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:41.460827 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzdps" event={"ID":"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949","Type":"ContainerStarted","Data":"e7f853985dad8dc5331f46c4316f2ed09df5f6672abd91c01c2c4fc00382e1dc"} Jun 11 21:24:41.573120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:41.573012 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-8qftt_78daced3-a5ee-414b-9c56-6e62644fc24a/download-server/0.log" Jun 11 21:24:42.466220 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:42.466178 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzdps" event={"ID":"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949","Type":"ContainerStarted","Data":"83d63f280e379a93f1218a29141ccf845bc3c819c62dfaef5469a372b6ebe3d6"} Jun 11 21:24:42.466627 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:42.466267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pzdps" event={"ID":"bd92ef1c-51b4-4a53-bcb4-3e1901dbe949","Type":"ContainerStarted","Data":"48db4592084780ee773f8e27499c2e3d25235bb1157222cfbf4f0c11e2eaa5c6"} Jun 11 21:24:42.482868 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:42.482808 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pzdps" podStartSLOduration=253.082899348 podStartE2EDuration="4m14.482794162s" totalImagesPullingTime="1.399894814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:42.481010457 +0000 UTC m=+254.425547838" watchObservedRunningTime="2026-06-11 21:24:42.482794162 +0000 UTC m=+254.427331542" Jun 11 21:24:42.566524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:42.566486 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:42.663961 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:42.663846 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:42.716084 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:42.716045 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:42.943495 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:42.943409 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:43.001311 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:43.001255 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:43.370431 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:43.370395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zkbvv_c03ec144-49ce-48a3-b6ab-2644e556a7e3/dns-node-resolver/0.log" Jun 11 21:24:43.751053 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:43.751004 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:43.771602 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:43.771571 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67995499b6-lvdms_130b62b1-9220-4d93-9349-85d0cc9ac8c4/registry/0.log" Jun 11 21:24:43.802678 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:43.802640 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:44.369772 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:44.369744 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6q2b_67719a28-cefc-469d-8582-fde072f45b8c/node-ca/0.log" Jun 11 21:24:44.970145 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:44.970076 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6zklz_70eb1d10-ae30-413a-aa9b-217e336182a7/serve-healthcheck-canary/0.log" Jun 11 21:24:48.101107 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:48.101062 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:24:48.101794 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:48.101756 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:24:50.262376 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:50.262339 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:50.310531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:50.310497 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:53.117346 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:53.117304 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" containerID="cri-o://56d225be8b7531dbf8993c0483ba57336b1c7fc77295c7f0b32ba3b8a0fce811" gracePeriod=30 Jun 11 21:24:53.251355 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:53.251328 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:53.354763 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:53.354731 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:53.514474 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:53.514446 2563 generic.go:356] "Generic (PLEG): container finished" podID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerID="56d225be8b7531dbf8993c0483ba57336b1c7fc77295c7f0b32ba3b8a0fce811" exitCode=0 Jun 11 21:24:53.514657 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:53.514512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67995499b6-lvdms" event={"ID":"130b62b1-9220-4d93-9349-85d0cc9ac8c4","Type":"ContainerDied","Data":"56d225be8b7531dbf8993c0483ba57336b1c7fc77295c7f0b32ba3b8a0fce811"} Jun 11 21:24:53.514657 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:53.514564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67995499b6-lvdms" event={"ID":"130b62b1-9220-4d93-9349-85d0cc9ac8c4","Type":"ContainerStarted","Data":"6c8a2819ef7c1ddcc1b50f55ac0c1a82320118f614fe9ab859b295315f208abb"} Jun 11 21:24:53.514782 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:53.514743 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:24:57.456859 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:57.456830 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:24:57.460841 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:24:57.460815 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7df7d5c7cd-f9qmr" Jun 11 21:25:02.617891 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:02.617848 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:02.675599 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:02.675559 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:07.001779 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:07.001729 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9vphm" podUID="e6f00c64-ef93-4f21-8468-93f4ee6cc61f" Jun 11 21:25:07.566638 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:07.566606 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vphm" Jun 11 21:25:08.074351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:08.074314 2563 patch_prober.go:28] interesting pod/image-registry-67995499b6-lvdms container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:25:08.074753 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:08.074387 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67995499b6-lvdms" podUID="130b62b1-9220-4d93-9349-85d0cc9ac8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:25:10.829054 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:10.829014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:25:10.831614 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:10.831594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f00c64-ef93-4f21-8468-93f4ee6cc61f-metrics-tls\") pod \"dns-default-9vphm\" (UID: \"e6f00c64-ef93-4f21-8468-93f4ee6cc61f\") " pod="openshift-dns/dns-default-9vphm" Jun 11 21:25:10.870502 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:10.870470 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2227\"" Jun 11 21:25:10.878355 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:10.878335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vphm" Jun 11 21:25:11.008680 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:11.008657 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vphm"] Jun 11 21:25:11.010256 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:25:11.010230 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f00c64_ef93_4f21_8468_93f4ee6cc61f.slice/crio-ec99577acb90b67f548e52ccf8b6c0fd4f60a920c33f6a220293b8fb4458bf65 WatchSource:0}: Error finding container ec99577acb90b67f548e52ccf8b6c0fd4f60a920c33f6a220293b8fb4458bf65: Status 404 returned error can't find the container with id ec99577acb90b67f548e52ccf8b6c0fd4f60a920c33f6a220293b8fb4458bf65 Jun 11 21:25:11.583556 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:11.583519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vphm" event={"ID":"e6f00c64-ef93-4f21-8468-93f4ee6cc61f","Type":"ContainerStarted","Data":"ec99577acb90b67f548e52ccf8b6c0fd4f60a920c33f6a220293b8fb4458bf65"} Jun 11 21:25:12.166304 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:12.166231 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:12.220107 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:12.220064 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:13.599456 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:13.599413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vphm" event={"ID":"e6f00c64-ef93-4f21-8468-93f4ee6cc61f","Type":"ContainerStarted","Data":"e7ef04c84dd82facee4cc869d630da230e1c3cc82dfc485eb768be9d9cc51d15"} Jun 11 21:25:13.599832 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:13.599475 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vphm" event={"ID":"e6f00c64-ef93-4f21-8468-93f4ee6cc61f","Type":"ContainerStarted","Data":"a8f299a546815d090111fd6d132e7a9ab6fd87aa4067cc79715af4f1365c9dfa"} Jun 11 21:25:13.599832 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:13.599526 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9vphm" Jun 11 21:25:13.615335 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:13.615257 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9vphm" podStartSLOduration=252.072802604 podStartE2EDuration="4m13.615241356s" totalImagesPullingTime="1.542438752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:13.614658113 +0000 UTC m=+285.559195494" watchObservedRunningTime="2026-06-11 21:25:13.615241356 +0000 UTC m=+285.559778736" Jun 11 21:25:14.522823 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:14.522791 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67995499b6-lvdms" Jun 11 21:25:14.645861 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:14.645816 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:14.747743 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:14.747707 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:14.848762 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:14.848687 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:18.107695 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:18.107656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:18.208328 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:18.208262 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:18.256314 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:18.256265 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:18.464331 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:18.464270 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:18.510520 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:18.510482 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:19.155694 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:19.155651 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:19.201836 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:19.201793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:19.284353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:19.284316 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:19.304722 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:19.304694 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:19.641568 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:19.641539 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:21.623383 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:21.623345 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:21.723775 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:21.723740 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:21.774576 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:21.774538 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:22.639581 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:22.639550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:22.688417 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:22.688382 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:23.606201 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:23.606174 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9vphm" Jun 11 21:25:28.437024 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:28.436990 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:25:28.444940 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:28.444912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:25:28.450949 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:28.450924 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 21:25:31.713950 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:31.713910 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:31.766764 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:31.766722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:31.924637 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:31.924593 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:32.228541 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.228504 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:32.728245 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.728211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:32.978612 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.978523 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:25:32.978840 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.978816 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="alertmanager" containerID="cri-o://598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0" gracePeriod=120 Jun 11 21:25:32.978897 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.978872 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-metric" containerID="cri-o://326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0" gracePeriod=120 Jun 11 21:25:32.978948 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.978892 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-web" containerID="cri-o://596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83" gracePeriod=120 Jun 11 21:25:32.978995 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.978929 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="config-reloader" containerID="cri-o://fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb" gracePeriod=120 Jun 11 21:25:32.978995 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.978938 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy" containerID="cri-o://cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407" gracePeriod=120 Jun 11 21:25:32.979105 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:32.979011 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="prom-label-proxy" containerID="cri-o://e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456" gracePeriod=120 Jun 11 21:25:33.687418 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687384 2563 generic.go:356] "Generic (PLEG): container finished" podID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerID="e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456" exitCode=0 Jun 11 21:25:33.687418 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687411 2563 generic.go:356] "Generic (PLEG): container finished" podID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerID="cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407" exitCode=0 Jun 11 21:25:33.687418 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687418 2563 generic.go:356] "Generic (PLEG): container finished" podID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerID="fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb" exitCode=0 Jun 11 21:25:33.687418 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687424 2563 generic.go:356] "Generic (PLEG): container finished" podID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerID="598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0" exitCode=0 Jun 11 21:25:33.687692 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456"} Jun 11 21:25:33.687692 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407"} Jun 11 21:25:33.687692 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb"} Jun 11 21:25:33.687692 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:33.687585 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0"} Jun 11 21:25:34.221467 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.221436 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.337395 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337304 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-web-config\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337395 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337353 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-out\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337615 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337395 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-web\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337615 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337427 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-tls-assets\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337615 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337458 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-trusted-ca-bundle\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337769 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337607 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337769 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337681 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-metrics-client-ca\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337769 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337707 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-main-tls\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337769 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337749 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-volume\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337779 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337811 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhbvh\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-kube-api-access-rhbvh\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337838 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-main-db\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.337958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337862 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:34.337958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.337879 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-cluster-tls-config\") pod \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\" (UID: \"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf\") " Jun 11 21:25:34.338209 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.338186 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.338442 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.338414 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:34.339324 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.339266 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:25:34.340221 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.340189 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-out" (OuterVolumeSpecName: "config-out") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:25:34.340221 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.340198 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:34.341154 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.341118 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:34.341680 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.341656 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:34.341790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.341729 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:34.341951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.341925 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-volume" (OuterVolumeSpecName: "config-volume") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:34.342224 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.342200 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-kube-api-access-rhbvh" (OuterVolumeSpecName: "kube-api-access-rhbvh") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "kube-api-access-rhbvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:34.342713 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.342673 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:34.346815 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.346787 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:34.353729 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.353708 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-web-config" (OuterVolumeSpecName: "web-config") pod "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" (UID: "61244c3c-4ac5-45eb-93d3-2cab4eeb07bf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:34.439324 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439297 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439324 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439323 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-metrics-client-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439335 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-main-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439345 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439355 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439365 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhbvh\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-kube-api-access-rhbvh\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439373 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-alertmanager-main-db\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439381 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-cluster-tls-config\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439390 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-web-config\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439397 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-config-out\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439405 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.439517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.439413 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf-tls-assets\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:34.694991 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.694904 2563 generic.go:356] "Generic (PLEG): container finished" podID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerID="326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0" exitCode=0 Jun 11 21:25:34.694991 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.694933 2563 generic.go:356] "Generic (PLEG): container finished" podID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerID="596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83" exitCode=0 Jun 11 21:25:34.695164 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.694985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0"} Jun 11 21:25:34.695164 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.695010 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.695164 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.695060 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83"} Jun 11 21:25:34.695164 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.695095 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61244c3c-4ac5-45eb-93d3-2cab4eeb07bf","Type":"ContainerDied","Data":"48b9a206279ced63528813b05eb440811f3da89bbcfa2e62ddcfc3640774f49b"} Jun 11 21:25:34.695164 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.695133 2563 scope.go:117] "RemoveContainer" containerID="e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456" Jun 11 21:25:34.702748 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.702727 2563 scope.go:117] "RemoveContainer" containerID="326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0" Jun 11 21:25:34.709876 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.709850 2563 scope.go:117] "RemoveContainer" containerID="cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407" Jun 11 21:25:34.717976 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.717861 2563 scope.go:117] "RemoveContainer" containerID="596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83" Jun 11 21:25:34.718267 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.718242 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:25:34.720143 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.720121 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:25:34.725632 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.725616 2563 scope.go:117] "RemoveContainer" containerID="fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb" Jun 11 21:25:34.732443 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.732423 2563 scope.go:117] "RemoveContainer" containerID="598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0" Jun 11 21:25:34.739662 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.739645 2563 scope.go:117] "RemoveContainer" containerID="4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b" Jun 11 21:25:34.747061 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.747045 2563 scope.go:117] "RemoveContainer" containerID="e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456" Jun 11 21:25:34.747479 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:34.747461 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456\": container with ID starting with e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456 not found: ID does not exist" containerID="e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456" Jun 11 21:25:34.747531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.747491 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456"} err="failed to get container status \"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456\": rpc error: code = NotFound desc = could not find container \"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456\": container with ID starting with e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456 not found: ID does not exist" Jun 11 21:25:34.747531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.747508 2563 scope.go:117] "RemoveContainer" containerID="326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0" Jun 11 21:25:34.747704 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.747684 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:25:34.747760 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:34.747740 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0\": container with ID starting with 326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0 not found: ID does not exist" containerID="326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0" Jun 11 21:25:34.747803 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.747772 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0"} err="failed to get container status \"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0\": rpc error: code = NotFound desc = could not find container \"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0\": container with ID starting with 326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0 not found: ID does not exist" Jun 11 21:25:34.747803 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.747794 2563 scope.go:117] "RemoveContainer" containerID="cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407" Jun 11 21:25:34.748038 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:34.748011 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407\": container with ID starting with cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407 not found: ID does not exist" containerID="cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407" Jun 11 21:25:34.748079 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748041 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407"} err="failed to get container status \"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407\": rpc error: code = NotFound desc = could not find container \"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407\": container with ID starting with cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407 not found: ID does not exist" Jun 11 21:25:34.748079 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748057 2563 scope.go:117] "RemoveContainer" containerID="596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748019 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="alertmanager" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748112 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="alertmanager" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748124 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748130 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748141 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-web" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748147 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-web" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748153 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="config-reloader" Jun 11 21:25:34.748158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748157 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="config-reloader" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748165 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="prom-label-proxy" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748170 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="prom-label-proxy" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748176 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="init-config-reloader" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748181 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="init-config-reloader" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748197 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-metric" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748202 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-metric" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748248 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-web" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748258 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="prom-label-proxy" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:34.748259 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83\": container with ID starting with 596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83 not found: ID does not exist" containerID="596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748312 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83"} err="failed to get container status \"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83\": rpc error: code = NotFound desc = could not find container \"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83\": container with ID starting with 596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83 not found: ID does not exist" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748330 2563 scope.go:117] "RemoveContainer" containerID="fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748265 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="alertmanager" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748377 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748386 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="config-reloader" Jun 11 21:25:34.748457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748395 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" containerName="kube-rbac-proxy-metric" Jun 11 21:25:34.749072 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:34.748572 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb\": container with ID starting with fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb not found: ID does not exist" containerID="fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb" Jun 11 21:25:34.749072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748598 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb"} err="failed to get container status \"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb\": rpc error: code = NotFound desc = could not find container \"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb\": container with ID starting with fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb not found: ID does not exist" Jun 11 21:25:34.749072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748615 2563 scope.go:117] "RemoveContainer" containerID="598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0" Jun 11 21:25:34.749072 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:34.748847 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0\": container with ID starting with 598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0 not found: ID does not exist" containerID="598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0" Jun 11 21:25:34.749072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748868 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0"} err="failed to get container status \"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0\": rpc error: code = NotFound desc = could not find container \"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0\": container with ID starting with 598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0 not found: ID does not exist" Jun 11 21:25:34.749072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.748880 2563 scope.go:117] "RemoveContainer" containerID="4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b" Jun 11 21:25:34.749260 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:34.749095 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b\": container with ID starting with 4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b not found: ID does not exist" containerID="4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b" Jun 11 21:25:34.749260 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749113 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b"} err="failed to get container status \"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b\": rpc error: code = NotFound desc = could not find container \"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b\": container with ID starting with 4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b not found: ID does not exist" Jun 11 21:25:34.749260 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749128 2563 scope.go:117] "RemoveContainer" containerID="e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456" Jun 11 21:25:34.749389 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749350 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456"} err="failed to get container status \"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456\": rpc error: code = NotFound desc = could not find container \"e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456\": container with ID starting with e22d9a810ef44abc4581248328d8c01da8ecb98bf6a843aa65083c2b25cd0456 not found: ID does not exist" Jun 11 21:25:34.749389 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749366 2563 scope.go:117] "RemoveContainer" containerID="326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0" Jun 11 21:25:34.749635 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749613 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0"} err="failed to get container status \"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0\": rpc error: code = NotFound desc = could not find container \"326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0\": container with ID starting with 326dc04eb1df339ac6d0e9edf31fda752709072514e43c5be41c3a0ca76e65c0 not found: ID does not exist" Jun 11 21:25:34.749718 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749637 2563 scope.go:117] "RemoveContainer" containerID="cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407" Jun 11 21:25:34.749954 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749919 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407"} err="failed to get container status \"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407\": rpc error: code = NotFound desc = could not find container \"cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407\": container with ID starting with cd95569a1d7008f86c8a681316a95a15dc41744569bb9e35367928d1ee636407 not found: ID does not exist" Jun 11 21:25:34.749954 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.749954 2563 scope.go:117] "RemoveContainer" containerID="596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.750205 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83"} err="failed to get container status \"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83\": rpc error: code = NotFound desc = could not find container \"596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83\": container with ID starting with 596a9efa630da5ded4e325cf770bec640c067f1adf6503a96797feaa2bf2aa83 not found: ID does not exist" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.750229 2563 scope.go:117] "RemoveContainer" containerID="fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.750595 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb"} err="failed to get container status \"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb\": rpc error: code = NotFound desc = could not find container \"fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb\": container with ID starting with fab79ebfa72b51a2f7f3dcae2a8d6337232e668d35262fd406119942a45e2cdb not found: ID does not exist" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.750620 2563 scope.go:117] "RemoveContainer" containerID="598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.750829 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0"} err="failed to get container status \"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0\": rpc error: code = NotFound desc = could not find container \"598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0\": container with ID starting with 598ce3f920ec4f1eb87f16ccbbd2b3d124d7205c93233ad5aa5392b4e0efd9c0 not found: ID does not exist" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.750848 2563 scope.go:117] "RemoveContainer" containerID="4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.751174 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b"} err="failed to get container status \"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b\": rpc error: code = NotFound desc = could not find container \"4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b\": container with ID starting with 4fd8e6c83b363549fbcb5036e3e38e7b8db12bd2e2cbfade95ac9781c3e6f44b not found: ID does not exist" Jun 11 21:25:34.752369 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.752065 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.754616 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.754596 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 21:25:34.754878 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.754860 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 21:25:34.754972 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.754891 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 21:25:34.754972 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.754891 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 21:25:34.755105 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.755012 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 21:25:34.755105 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.755012 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ljkbd\"" Jun 11 21:25:34.755240 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.755135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 21:25:34.755240 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.755210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 21:25:34.755389 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.755363 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 21:25:34.763988 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.763128 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 21:25:34.767361 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.767338 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:25:34.842875 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.842844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-config-out\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.842879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.842926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.842944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.842959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.842976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-web-config\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.842994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843205 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.843010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843205 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.843030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843205 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.843048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9b85\" (UniqueName: \"kubernetes.io/projected/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-kube-api-access-f9b85\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843205 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.843064 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843205 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.843143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.843205 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.843178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944493 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-config-out\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944493 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-web-config\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944952 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9b85\" (UniqueName: \"kubernetes.io/projected/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-kube-api-access-f9b85\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944952 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944952 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.944952 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.944816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.945588 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.945525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.945798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.945571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948029 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.947995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948029 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.947995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-web-config\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948184 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.948012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948184 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.948027 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948310 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.948267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948575 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.948553 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-config-out\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.948679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948765 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.948747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.948802 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.948753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-config-volume\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.949939 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.949918 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:34.953437 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:34.953417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9b85\" (UniqueName: \"kubernetes.io/projected/32c62617-c307-4080-b4f9-7ee8a3eb3d0b-kube-api-access-f9b85\") pod \"alertmanager-main-0\" (UID: \"32c62617-c307-4080-b4f9-7ee8a3eb3d0b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:35.066706 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:35.066673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 21:25:35.207531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:35.207142 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 21:25:35.209833 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:25:35.209794 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c62617_c307_4080_b4f9_7ee8a3eb3d0b.slice/crio-4b4a5081cf98955cff43be1bde9e8dcf7a39505dada81d5abdc39ae06bb31b68 WatchSource:0}: Error finding container 4b4a5081cf98955cff43be1bde9e8dcf7a39505dada81d5abdc39ae06bb31b68: Status 404 returned error can't find the container with id 4b4a5081cf98955cff43be1bde9e8dcf7a39505dada81d5abdc39ae06bb31b68 Jun 11 21:25:35.256881 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:35.256843 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:35.357809 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:35.357775 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:35.701002 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:35.700974 2563 generic.go:356] "Generic (PLEG): container finished" podID="32c62617-c307-4080-b4f9-7ee8a3eb3d0b" containerID="e769c67f02d721b9c9f1529296528581b9b4611d01521beed9019b3a4f8c9c04" exitCode=0 Jun 11 21:25:35.701189 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:35.701067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerDied","Data":"e769c67f02d721b9c9f1529296528581b9b4611d01521beed9019b3a4f8c9c04"} Jun 11 21:25:35.701189 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:35.701155 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerStarted","Data":"4b4a5081cf98955cff43be1bde9e8dcf7a39505dada81d5abdc39ae06bb31b68"} Jun 11 21:25:36.500072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.500040 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61244c3c-4ac5-45eb-93d3-2cab4eeb07bf" path="/var/lib/kubelet/pods/61244c3c-4ac5-45eb-93d3-2cab4eeb07bf/volumes" Jun 11 21:25:36.709839 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.709804 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerStarted","Data":"76c1cab0caaf8e0001621ed3ff2cf89dcc90678685fe4a29d4df782f2c004431"} Jun 11 21:25:36.710028 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.709871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerStarted","Data":"d8ddbe2d561d649e88c6aaf9ecafdb37cab83b18d1be10b1326721a66e5b8116"} Jun 11 21:25:36.710028 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.709902 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerStarted","Data":"84d72170d554f36acc52d2dec2bfae777a0bfd855180a2a2bfb8a64fc304d60a"} Jun 11 21:25:36.710028 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.709927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerStarted","Data":"ca00b5977c25005fad664c6095baad324b306050dda0b432bd6c3768b4ef41ed"} Jun 11 21:25:36.710028 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.709951 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerStarted","Data":"935a5df6acf27393e980318619af05dfb175185cee0034856b39978c9a467229"} Jun 11 21:25:36.710028 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.709979 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"32c62617-c307-4080-b4f9-7ee8a3eb3d0b","Type":"ContainerStarted","Data":"e064b5413aae3a1cac4fff5c5bc53fcfdc928eb106026d473cfb3eca950ee42e"} Jun 11 21:25:36.737115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:36.737058 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.718657906 podStartE2EDuration="2.737039975s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.382069ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:36.73596066 +0000 UTC m=+308.680498066" watchObservedRunningTime="2026-06-11 21:25:36.737039975 +0000 UTC m=+308.681577355" Jun 11 21:25:37.001906 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.001866 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7798df696b-dhdmx"] Jun 11 21:25:37.005538 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.005510 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.009501 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.009322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 21:25:37.009501 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.009332 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5hw4m\"" Jun 11 21:25:37.009501 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.009363 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 21:25:37.009501 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.009376 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 21:25:37.009501 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.009435 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 21:25:37.009501 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.009493 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 21:25:37.014256 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.014232 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 21:25:37.016880 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.016849 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7798df696b-dhdmx"] Jun 11 21:25:37.165172 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.165172 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.165172 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-federate-client-tls\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.165172 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-secret-telemeter-client\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.165496 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-serving-certs-ca-bundle\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.165496 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-telemeter-client-tls\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.165496 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-metrics-client-ca\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.165496 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.165384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vncr8\" (UniqueName: \"kubernetes.io/projected/0a65437e-f929-42ae-b677-9a49fcb13818-kube-api-access-vncr8\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266168 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-serving-certs-ca-bundle\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266168 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-telemeter-client-tls\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266168 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-metrics-client-ca\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266521 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vncr8\" (UniqueName: \"kubernetes.io/projected/0a65437e-f929-42ae-b677-9a49fcb13818-kube-api-access-vncr8\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266521 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266521 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266521 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-federate-client-tls\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266521 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-secret-telemeter-client\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.266978 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266939 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-serving-certs-ca-bundle\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.267261 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.266997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-metrics-client-ca\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.267592 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.267571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a65437e-f929-42ae-b677-9a49fcb13818-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.268993 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.268969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-federate-client-tls\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.269106 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.269073 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.269574 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.269554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-telemeter-client-tls\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.269625 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.269560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0a65437e-f929-42ae-b677-9a49fcb13818-secret-telemeter-client\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.274318 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.274264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vncr8\" (UniqueName: \"kubernetes.io/projected/0a65437e-f929-42ae-b677-9a49fcb13818-kube-api-access-vncr8\") pod \"telemeter-client-7798df696b-dhdmx\" (UID: \"0a65437e-f929-42ae-b677-9a49fcb13818\") " pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.299957 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.299918 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:25:37.300390 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.300355 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="prometheus" containerID="cri-o://ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" gracePeriod=600 Jun 11 21:25:37.300491 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.300372 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy" containerID="cri-o://a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" gracePeriod=600 Jun 11 21:25:37.300491 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.300403 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="thanos-sidecar" containerID="cri-o://43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" gracePeriod=600 Jun 11 21:25:37.300491 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.300407 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="config-reloader" containerID="cri-o://b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" gracePeriod=600 Jun 11 21:25:37.300644 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.300382 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-thanos" containerID="cri-o://86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" gracePeriod=600 Jun 11 21:25:37.300644 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.300554 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-web" containerID="cri-o://e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" gracePeriod=600 Jun 11 21:25:37.318808 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.318777 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" Jun 11 21:25:37.492151 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.491977 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7798df696b-dhdmx"] Jun 11 21:25:37.494481 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:25:37.494439 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a65437e_f929_42ae_b677_9a49fcb13818.slice/crio-cf81a6328d2e8fb4efd452434e7d419d4dd4a27bba23fdb9a01646b7d6a1a316 WatchSource:0}: Error finding container cf81a6328d2e8fb4efd452434e7d419d4dd4a27bba23fdb9a01646b7d6a1a316: Status 404 returned error can't find the container with id cf81a6328d2e8fb4efd452434e7d419d4dd4a27bba23fdb9a01646b7d6a1a316 Jun 11 21:25:37.496768 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.496752 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:25:37.554451 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.554425 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.671027 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.670993 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-0\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671027 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671026 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-tls-assets\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671251 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671046 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-1\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671251 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671063 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671251 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671102 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-kubelet-serving-ca-bundle\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671251 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671132 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-config\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671251 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671168 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-serving-certs-ca-bundle\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671251 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671205 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-grpc-tls\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671573 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671421 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:37.671573 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671547 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671676 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671586 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-db\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671676 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671598 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:37.671676 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671637 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-config-out\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671833 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671690 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-metrics-client-certs\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671833 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671715 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-trusted-ca-bundle\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.671833 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671714 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:37.671833 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671745 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-metrics-client-ca\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.672032 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671940 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-thanos-prometheus-http-client-file\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.672032 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.671974 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txxf9\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-kube-api-access-txxf9\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.672032 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672002 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-tls\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.672180 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672034 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-kube-rbac-proxy\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.672180 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672063 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-web-config\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.672180 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672112 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-2\") pod \"8cf93b3a-4291-428e-8905-11d37f65c894\" (UID: \"8cf93b3a-4291-428e-8905-11d37f65c894\") " Jun 11 21:25:37.673798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672388 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:37.673798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672468 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.673798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672489 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.673798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672504 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.673798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672519 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.673798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.672695 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:37.673798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.673174 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:25:37.674457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.674112 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:37.674457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.674144 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:25:37.675316 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.675293 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-config-out" (OuterVolumeSpecName: "config-out") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:25:37.675504 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.675391 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.675618 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.675462 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-kube-api-access-txxf9" (OuterVolumeSpecName: "kube-api-access-txxf9") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "kube-api-access-txxf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:37.676408 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.676351 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.676504 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.676403 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.676504 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.676423 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.676504 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.676432 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.676504 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.676474 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:37.676712 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.676561 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-config" (OuterVolumeSpecName: "config") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.677457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.677439 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.677973 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.677943 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.687408 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.687387 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-web-config" (OuterVolumeSpecName: "web-config") pod "8cf93b3a-4291-428e-8905-11d37f65c894" (UID: "8cf93b3a-4291-428e-8905-11d37f65c894"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:25:37.715841 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.715784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" event={"ID":"0a65437e-f929-42ae-b677-9a49fcb13818","Type":"ContainerStarted","Data":"cf81a6328d2e8fb4efd452434e7d419d4dd4a27bba23fdb9a01646b7d6a1a316"} Jun 11 21:25:37.718779 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718759 2563 generic.go:356] "Generic (PLEG): container finished" podID="8cf93b3a-4291-428e-8905-11d37f65c894" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" exitCode=0 Jun 11 21:25:37.718779 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718779 2563 generic.go:356] "Generic (PLEG): container finished" podID="8cf93b3a-4291-428e-8905-11d37f65c894" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" exitCode=0 Jun 11 21:25:37.718915 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718788 2563 generic.go:356] "Generic (PLEG): container finished" podID="8cf93b3a-4291-428e-8905-11d37f65c894" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" exitCode=0 Jun 11 21:25:37.718915 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718798 2563 generic.go:356] "Generic (PLEG): container finished" podID="8cf93b3a-4291-428e-8905-11d37f65c894" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" exitCode=0 Jun 11 21:25:37.718915 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718808 2563 generic.go:356] "Generic (PLEG): container finished" podID="8cf93b3a-4291-428e-8905-11d37f65c894" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" exitCode=0 Jun 11 21:25:37.718915 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718814 2563 generic.go:356] "Generic (PLEG): container finished" podID="8cf93b3a-4291-428e-8905-11d37f65c894" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" exitCode=0 Jun 11 21:25:37.718915 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718833 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.718915 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} Jun 11 21:25:37.719207 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} Jun 11 21:25:37.719207 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.718972 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} Jun 11 21:25:37.719207 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.719014 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} Jun 11 21:25:37.719207 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.719027 2563 scope.go:117] "RemoveContainer" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.719207 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.719060 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} Jun 11 21:25:37.719207 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.719091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} Jun 11 21:25:37.719207 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.719125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8cf93b3a-4291-428e-8905-11d37f65c894","Type":"ContainerDied","Data":"5e0577094ad8817aa6ffe77d78d0326d770d0deec9a944fd178987bf3517f1f6"} Jun 11 21:25:37.729583 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.729568 2563 scope.go:117] "RemoveContainer" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.736712 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.736696 2563 scope.go:117] "RemoveContainer" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.743378 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.743340 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:25:37.744611 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.744589 2563 scope.go:117] "RemoveContainer" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.746959 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.746939 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:25:37.752481 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.752459 2563 scope.go:117] "RemoveContainer" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.759718 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.759701 2563 scope.go:117] "RemoveContainer" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.767353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.767334 2563 scope.go:117] "RemoveContainer" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.773626 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773605 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773627 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-tls-assets\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773638 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773647 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-config\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773655 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-grpc-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773664 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773672 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-k8s-db\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773680 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cf93b3a-4291-428e-8905-11d37f65c894-config-out\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773690 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-metrics-client-certs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773700 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773708 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cf93b3a-4291-428e-8905-11d37f65c894-configmap-metrics-client-ca\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.773719 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773717 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.774433 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773725 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txxf9\" (UniqueName: \"kubernetes.io/projected/8cf93b3a-4291-428e-8905-11d37f65c894-kube-api-access-txxf9\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.774433 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773735 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.774433 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773743 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-secret-kube-rbac-proxy\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.774433 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.773751 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cf93b3a-4291-428e-8905-11d37f65c894-web-config\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:25:37.775141 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.775122 2563 scope.go:117] "RemoveContainer" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.775497 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:37.775468 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": container with ID starting with 86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44 not found: ID does not exist" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.775574 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.775508 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} err="failed to get container status \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": rpc error: code = NotFound desc = could not find container \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": container with ID starting with 86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44 not found: ID does not exist" Jun 11 21:25:37.775574 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.775533 2563 scope.go:117] "RemoveContainer" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.775808 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:37.775787 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": container with ID starting with a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625 not found: ID does not exist" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.775854 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.775813 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} err="failed to get container status \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": rpc error: code = NotFound desc = could not find container \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": container with ID starting with a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625 not found: ID does not exist" Jun 11 21:25:37.775854 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.775831 2563 scope.go:117] "RemoveContainer" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.776117 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:37.776096 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": container with ID starting with e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9 not found: ID does not exist" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.776178 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776125 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} err="failed to get container status \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": rpc error: code = NotFound desc = could not find container \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": container with ID starting with e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9 not found: ID does not exist" Jun 11 21:25:37.776178 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776145 2563 scope.go:117] "RemoveContainer" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.776351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776334 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:25:37.776400 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:37.776372 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": container with ID starting with 43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31 not found: ID does not exist" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.776441 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776393 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} err="failed to get container status \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": rpc error: code = NotFound desc = could not find container \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": container with ID starting with 43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31 not found: ID does not exist" Jun 11 21:25:37.776441 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776412 2563 scope.go:117] "RemoveContainer" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.776671 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:37.776654 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": container with ID starting with b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd not found: ID does not exist" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.776720 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776674 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} err="failed to get container status \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": rpc error: code = NotFound desc = could not find container \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": container with ID starting with b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd not found: ID does not exist" Jun 11 21:25:37.776720 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776689 2563 scope.go:117] "RemoveContainer" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.776787 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776691 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="config-reloader" Jun 11 21:25:37.776787 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776749 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="config-reloader" Jun 11 21:25:37.776787 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776769 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="init-config-reloader" Jun 11 21:25:37.776787 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776780 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="init-config-reloader" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776794 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776802 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776821 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="thanos-sidecar" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776829 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="thanos-sidecar" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776837 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-thanos" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776845 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-thanos" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776863 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="prometheus" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776871 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="prometheus" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776883 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-web" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776889 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-web" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:37.776910 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": container with ID starting with ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220 not found: ID does not exist" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.776932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776931 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} err="failed to get container status \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": rpc error: code = NotFound desc = could not find container \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": container with ID starting with ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220 not found: ID does not exist" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776943 2563 scope.go:117] "RemoveContainer" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776964 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-web" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776975 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="config-reloader" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776981 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="thanos-sidecar" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776988 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="prometheus" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776994 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.776998 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" containerName="kube-rbac-proxy-thanos" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:25:37.777187 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": container with ID starting with 1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2 not found: ID does not exist" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777207 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2"} err="failed to get container status \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": rpc error: code = NotFound desc = could not find container \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": container with ID starting with 1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2 not found: ID does not exist" Jun 11 21:25:37.777377 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777221 2563 scope.go:117] "RemoveContainer" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.777708 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777453 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} err="failed to get container status \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": rpc error: code = NotFound desc = could not find container \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": container with ID starting with 86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44 not found: ID does not exist" Jun 11 21:25:37.777708 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777474 2563 scope.go:117] "RemoveContainer" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.777708 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777694 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} err="failed to get container status \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": rpc error: code = NotFound desc = could not find container \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": container with ID starting with a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625 not found: ID does not exist" Jun 11 21:25:37.777708 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777708 2563 scope.go:117] "RemoveContainer" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.777945 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777924 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} err="failed to get container status \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": rpc error: code = NotFound desc = could not find container \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": container with ID starting with e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9 not found: ID does not exist" Jun 11 21:25:37.777945 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.777945 2563 scope.go:117] "RemoveContainer" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.778193 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778176 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} err="failed to get container status \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": rpc error: code = NotFound desc = could not find container \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": container with ID starting with 43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31 not found: ID does not exist" Jun 11 21:25:37.778193 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778193 2563 scope.go:117] "RemoveContainer" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.778421 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778402 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} err="failed to get container status \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": rpc error: code = NotFound desc = could not find container \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": container with ID starting with b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd not found: ID does not exist" Jun 11 21:25:37.778488 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778420 2563 scope.go:117] "RemoveContainer" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.778646 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778629 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} err="failed to get container status \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": rpc error: code = NotFound desc = could not find container \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": container with ID starting with ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220 not found: ID does not exist" Jun 11 21:25:37.778690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778646 2563 scope.go:117] "RemoveContainer" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.778880 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778863 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2"} err="failed to get container status \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": rpc error: code = NotFound desc = could not find container \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": container with ID starting with 1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2 not found: ID does not exist" Jun 11 21:25:37.778924 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.778882 2563 scope.go:117] "RemoveContainer" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.779126 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779105 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} err="failed to get container status \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": rpc error: code = NotFound desc = could not find container \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": container with ID starting with 86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44 not found: ID does not exist" Jun 11 21:25:37.779182 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779126 2563 scope.go:117] "RemoveContainer" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.779360 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779337 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} err="failed to get container status \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": rpc error: code = NotFound desc = could not find container \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": container with ID starting with a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625 not found: ID does not exist" Jun 11 21:25:37.779360 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779359 2563 scope.go:117] "RemoveContainer" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.779578 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779559 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} err="failed to get container status \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": rpc error: code = NotFound desc = could not find container \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": container with ID starting with e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9 not found: ID does not exist" Jun 11 21:25:37.779620 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779579 2563 scope.go:117] "RemoveContainer" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.779780 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779755 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} err="failed to get container status \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": rpc error: code = NotFound desc = could not find container \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": container with ID starting with 43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31 not found: ID does not exist" Jun 11 21:25:37.779819 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779782 2563 scope.go:117] "RemoveContainer" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.779970 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779956 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} err="failed to get container status \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": rpc error: code = NotFound desc = could not find container \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": container with ID starting with b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd not found: ID does not exist" Jun 11 21:25:37.780015 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.779970 2563 scope.go:117] "RemoveContainer" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.780152 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780136 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} err="failed to get container status \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": rpc error: code = NotFound desc = could not find container \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": container with ID starting with ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220 not found: ID does not exist" Jun 11 21:25:37.780204 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780153 2563 scope.go:117] "RemoveContainer" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.780339 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780323 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2"} err="failed to get container status \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": rpc error: code = NotFound desc = could not find container \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": container with ID starting with 1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2 not found: ID does not exist" Jun 11 21:25:37.780396 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780338 2563 scope.go:117] "RemoveContainer" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.780511 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780496 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} err="failed to get container status \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": rpc error: code = NotFound desc = could not find container \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": container with ID starting with 86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44 not found: ID does not exist" Jun 11 21:25:37.780562 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780511 2563 scope.go:117] "RemoveContainer" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.780683 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780667 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} err="failed to get container status \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": rpc error: code = NotFound desc = could not find container \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": container with ID starting with a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625 not found: ID does not exist" Jun 11 21:25:37.780739 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780682 2563 scope.go:117] "RemoveContainer" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.780794 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.780892 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780872 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} err="failed to get container status \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": rpc error: code = NotFound desc = could not find container \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": container with ID starting with e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9 not found: ID does not exist" Jun 11 21:25:37.780948 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.780893 2563 scope.go:117] "RemoveContainer" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.781455 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.781425 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} err="failed to get container status \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": rpc error: code = NotFound desc = could not find container \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": container with ID starting with 43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31 not found: ID does not exist" Jun 11 21:25:37.781455 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.781455 2563 scope.go:117] "RemoveContainer" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.781776 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.781746 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} err="failed to get container status \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": rpc error: code = NotFound desc = could not find container \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": container with ID starting with b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd not found: ID does not exist" Jun 11 21:25:37.781889 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.781779 2563 scope.go:117] "RemoveContainer" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.782016 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.781996 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} err="failed to get container status \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": rpc error: code = NotFound desc = could not find container \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": container with ID starting with ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220 not found: ID does not exist" Jun 11 21:25:37.782080 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.782018 2563 scope.go:117] "RemoveContainer" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.782375 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.782263 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2"} err="failed to get container status \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": rpc error: code = NotFound desc = could not find container \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": container with ID starting with 1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2 not found: ID does not exist" Jun 11 21:25:37.782468 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.782379 2563 scope.go:117] "RemoveContainer" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.782653 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.782632 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} err="failed to get container status \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": rpc error: code = NotFound desc = could not find container \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": container with ID starting with 86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44 not found: ID does not exist" Jun 11 21:25:37.782714 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.782655 2563 scope.go:117] "RemoveContainer" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.782898 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.782880 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} err="failed to get container status \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": rpc error: code = NotFound desc = could not find container \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": container with ID starting with a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625 not found: ID does not exist" Jun 11 21:25:37.782940 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.782900 2563 scope.go:117] "RemoveContainer" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.783116 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783094 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} err="failed to get container status \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": rpc error: code = NotFound desc = could not find container \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": container with ID starting with e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9 not found: ID does not exist" Jun 11 21:25:37.783163 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783117 2563 scope.go:117] "RemoveContainer" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.783466 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783436 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} err="failed to get container status \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": rpc error: code = NotFound desc = could not find container \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": container with ID starting with 43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31 not found: ID does not exist" Jun 11 21:25:37.783466 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783466 2563 scope.go:117] "RemoveContainer" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.783626 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783470 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 21:25:37.783626 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783481 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 21:25:37.783626 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783533 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 21:25:37.783626 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783548 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 21:25:37.783902 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783766 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} err="failed to get container status \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": rpc error: code = NotFound desc = could not find container \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": container with ID starting with b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd not found: ID does not exist" Jun 11 21:25:37.783902 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783784 2563 scope.go:117] "RemoveContainer" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.783902 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.783873 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 21:25:37.784103 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784021 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 21:25:37.784103 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784056 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} err="failed to get container status \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": rpc error: code = NotFound desc = could not find container \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": container with ID starting with ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220 not found: ID does not exist" Jun 11 21:25:37.784103 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784076 2563 scope.go:117] "RemoveContainer" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.784550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784133 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 21:25:37.784550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784271 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 21:25:37.784550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784343 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2"} err="failed to get container status \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": rpc error: code = NotFound desc = could not find container \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": container with ID starting with 1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2 not found: ID does not exist" Jun 11 21:25:37.784550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784364 2563 scope.go:117] "RemoveContainer" containerID="86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44" Jun 11 21:25:37.784550 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784465 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 21:25:37.784862 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784770 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44"} err="failed to get container status \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": rpc error: code = NotFound desc = could not find container \"86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44\": container with ID starting with 86b28ab48689bf9a77b468aba176bb689e31d502e876a38b25423ff3da6b2a44 not found: ID does not exist" Jun 11 21:25:37.784862 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784787 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 21:25:37.784862 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784796 2563 scope.go:117] "RemoveContainer" containerID="a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625" Jun 11 21:25:37.784862 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784810 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7qrnh448du5va\"" Jun 11 21:25:37.784862 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784779 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 21:25:37.785174 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.784929 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6dbm\"" Jun 11 21:25:37.785174 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.785033 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 21:25:37.785174 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.785094 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625"} err="failed to get container status \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": rpc error: code = NotFound desc = could not find container \"a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625\": container with ID starting with a8b7c5440823d9772ccf1e150d13fe68a085ebbb98145f37d0e222f5f7b27625 not found: ID does not exist" Jun 11 21:25:37.785174 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.785113 2563 scope.go:117] "RemoveContainer" containerID="e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9" Jun 11 21:25:37.785598 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.785570 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9"} err="failed to get container status \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": rpc error: code = NotFound desc = could not find container \"e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9\": container with ID starting with e8288d0f6b2efdc6b26126b8cd51a19d1f852b647771a98e7cfdbc63ecc241c9 not found: ID does not exist" Jun 11 21:25:37.785598 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.785602 2563 scope.go:117] "RemoveContainer" containerID="43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31" Jun 11 21:25:37.786591 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.786328 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31"} err="failed to get container status \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": rpc error: code = NotFound desc = could not find container \"43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31\": container with ID starting with 43db0aecdcb790b410010b2832b7ca2a7c8898b73a1e509f61d71b809a805e31 not found: ID does not exist" Jun 11 21:25:37.786591 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.786359 2563 scope.go:117] "RemoveContainer" containerID="b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd" Jun 11 21:25:37.790445 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.790418 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd"} err="failed to get container status \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": rpc error: code = NotFound desc = could not find container \"b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd\": container with ID starting with b209781fb1deabaf7b6d2d1fce065bb4d51ca3f6ed7d1b7abc557d8eb99589bd not found: ID does not exist" Jun 11 21:25:37.790562 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.790446 2563 scope.go:117] "RemoveContainer" containerID="ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220" Jun 11 21:25:37.790770 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.790743 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220"} err="failed to get container status \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": rpc error: code = NotFound desc = could not find container \"ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220\": container with ID starting with ae20c28a5f6aa1a068c602b7993af7bb1960e9efbf3380fd1d0dab2ae774b220 not found: ID does not exist" Jun 11 21:25:37.790853 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.790773 2563 scope.go:117] "RemoveContainer" containerID="1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2" Jun 11 21:25:37.790909 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.790881 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 21:25:37.791075 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.791053 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2"} err="failed to get container status \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": rpc error: code = NotFound desc = could not find container \"1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2\": container with ID starting with 1ef210af6e0f17f53cdaaac046dbb78d52fa22c792e90b40445125a2ee403ea2 not found: ID does not exist" Jun 11 21:25:37.797658 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.797599 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 21:25:37.797907 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.797884 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:25:37.874663 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.874663 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.874853 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3f12a0d-2770-4e82-879c-3cbac57651dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.874853 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.874853 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.874853 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875081 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875081 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-config\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875081 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875081 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.874981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875081 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875319 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkqm\" (UniqueName: \"kubernetes.io/projected/f3f12a0d-2770-4e82-879c-3cbac57651dc-kube-api-access-sxkqm\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875319 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875422 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3f12a0d-2770-4e82-879c-3cbac57651dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875589 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875589 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875669 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875669 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.875754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.875692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.976893 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.976855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.976893 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.976897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977118 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.976918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977118 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.976959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977118 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.976980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3f12a0d-2770-4e82-879c-3cbac57651dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977118 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977349 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977349 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977634 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977766 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977766 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977888 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977888 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-config\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977995 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977995 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977995 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.977995 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977983 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.978201 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.977997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkqm\" (UniqueName: \"kubernetes.io/projected/f3f12a0d-2770-4e82-879c-3cbac57651dc-kube-api-access-sxkqm\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.978201 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.978043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.978201 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.978081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.978201 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.978145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3f12a0d-2770-4e82-879c-3cbac57651dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.978201 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.978174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.978471 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.978203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.978471 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.978233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.980253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.980300 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.980313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.980825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-config\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.980949 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.981137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.981269 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981454 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.981397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3f12a0d-2770-4e82-879c-3cbac57651dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981964 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.981488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.981964 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.981584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.982154 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.982133 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3f12a0d-2770-4e82-879c-3cbac57651dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.982831 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.982806 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.982911 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.982881 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3f12a0d-2770-4e82-879c-3cbac57651dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.983492 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.983476 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.983665 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.983648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3f12a0d-2770-4e82-879c-3cbac57651dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:37.985482 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:37.985466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkqm\" (UniqueName: \"kubernetes.io/projected/f3f12a0d-2770-4e82-879c-3cbac57651dc-kube-api-access-sxkqm\") pod \"prometheus-k8s-0\" (UID: \"f3f12a0d-2770-4e82-879c-3cbac57651dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:38.095979 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:38.095904 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:38.239231 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:38.239089 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:25:38.241808 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:25:38.241783 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f12a0d_2770_4e82_879c_3cbac57651dc.slice/crio-c5ec2e91007c7f7ed1c843f993ff6a9156994bc6b36fdab04a90960745736f52 WatchSource:0}: Error finding container c5ec2e91007c7f7ed1c843f993ff6a9156994bc6b36fdab04a90960745736f52: Status 404 returned error can't find the container with id c5ec2e91007c7f7ed1c843f993ff6a9156994bc6b36fdab04a90960745736f52 Jun 11 21:25:38.500206 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:38.500174 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cf93b3a-4291-428e-8905-11d37f65c894" path="/var/lib/kubelet/pods/8cf93b3a-4291-428e-8905-11d37f65c894/volumes" Jun 11 21:25:38.726017 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:38.725979 2563 generic.go:356] "Generic (PLEG): container finished" podID="f3f12a0d-2770-4e82-879c-3cbac57651dc" containerID="16edd71c78a73c0c73c4b9d0260479c15711c786eb81849db50739dbfa8b4c60" exitCode=0 Jun 11 21:25:38.726429 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:38.726053 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerDied","Data":"16edd71c78a73c0c73c4b9d0260479c15711c786eb81849db50739dbfa8b4c60"} Jun 11 21:25:38.726429 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:38.726128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerStarted","Data":"c5ec2e91007c7f7ed1c843f993ff6a9156994bc6b36fdab04a90960745736f52"} Jun 11 21:25:39.734160 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.734114 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerStarted","Data":"d7bdb24d93badfae370bc3f291575c4605203d428b1f9d473344575955886c07"} Jun 11 21:25:39.734627 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.734243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerStarted","Data":"4da5090f8c9cfdcace8c981bb87673f9c05e3ebd6541b2fc161f5bb5f5319bdd"} Jun 11 21:25:39.734627 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.734331 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerStarted","Data":"6e0df47c68ad8e41ff4a5a677e3a95c82aca10e21fe056c850a9c33dfe9e7014"} Jun 11 21:25:39.734627 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.734378 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerStarted","Data":"acdd1f7859f8489369d05f5efa3626343ad36704d2bcdfcbec08d96dcb6bb78a"} Jun 11 21:25:39.734627 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.734408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerStarted","Data":"8d9de2b4a5fb57da5fbb49f753e940d89c7f46655fa709afb050d17a0d0e5740"} Jun 11 21:25:39.734627 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.734446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3f12a0d-2770-4e82-879c-3cbac57651dc","Type":"ContainerStarted","Data":"c1d597b4b687b32506e3db320829cc4b54bb37dd5028c15c5f67496b0c0b2f98"} Jun 11 21:25:39.736264 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.736236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" event={"ID":"0a65437e-f929-42ae-b677-9a49fcb13818","Type":"ContainerStarted","Data":"0bc466c7e272a1cb626f4ac842e2cc2d815602d1d252212754d49d68a02a3f0e"} Jun 11 21:25:39.736361 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.736316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" event={"ID":"0a65437e-f929-42ae-b677-9a49fcb13818","Type":"ContainerStarted","Data":"061542f8100116beaf1c853147fbaccf358f14f9f116609c5da50873f699c6a3"} Jun 11 21:25:39.736361 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.736349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" event={"ID":"0a65437e-f929-42ae-b677-9a49fcb13818","Type":"ContainerStarted","Data":"b8b50073246ed476de996441170418c1c80d9955b462fcbe23ad26823c54149a"} Jun 11 21:25:39.763819 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.763768 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7445314549999997 podStartE2EDuration="2.763752371s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.220916ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:39.761226855 +0000 UTC m=+311.705764285" watchObservedRunningTime="2026-06-11 21:25:39.763752371 +0000 UTC m=+311.708289752" Jun 11 21:25:39.783024 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:39.782977 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7798df696b-dhdmx" podStartSLOduration=1.815852681 podStartE2EDuration="3.78296348s" totalImagesPullingTime="1.967110799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:39.78113176 +0000 UTC m=+311.725669176" watchObservedRunningTime="2026-06-11 21:25:39.78296348 +0000 UTC m=+311.727500861" Jun 11 21:25:40.540681 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:40.540644 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:40.639242 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:40.639206 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:41.727967 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:41.727932 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:41.781596 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:41.781558 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:43.096714 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:43.096674 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:25:50.260039 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:50.260003 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:50.309300 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:50.309260 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:50.985291 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:50.985248 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:51.038790 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:51.038753 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:51.091370 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:25:51.091333 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:00.162563 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:00.162526 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:00.262773 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:00.262741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:38.096341 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:38.096271 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:26:38.112954 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:38.112931 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:26:38.991132 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:38.991105 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:26:47.152705 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:47.152670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:47.213803 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:47.213761 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:58.996116 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:58.996080 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:59.041480 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:26:59.041422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:02.324920 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:02.324877 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:02.383016 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:02.382966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:05.266178 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:05.266137 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:05.367452 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:05.367414 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:05.611250 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:05.611143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:13.311579 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:13.311532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:13.412890 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:13.412858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:13.463484 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:13.463447 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:21.841597 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:21.841547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:21.935392 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:21.935357 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:43.501236 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:43.501196 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:44.911678 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:44.911639 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:48.114967 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:48.114934 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:48.215706 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:48.215638 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:55.439250 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:55.439203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:55.538200 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:55.538165 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:55.864443 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:55.864400 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:55.966971 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:55.966934 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:56.073152 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:56.073118 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:58.716888 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:58.716856 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:27:59.307590 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:27:59.307556 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:07.116585 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:07.116509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:07.777813 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:07.777768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:30.386457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:30.386423 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:31.732129 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:31.732098 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:38.676932 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:38.676893 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:38.777878 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:38.777839 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:44.519147 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:44.519099 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:44.620003 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:44.619967 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:46.405753 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:46.405722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:50.591094 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.591055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:50.649877 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.649842 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz"] Jun 11 21:28:50.653167 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.653144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.655754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.655728 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 21:28:50.655889 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.655758 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 21:28:50.656746 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.656731 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:28:50.656825 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.656740 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gtz27\"" Jun 11 21:28:50.657106 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.657088 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 21:28:50.657178 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.657146 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 21:28:50.665326 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.664789 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:28:50.668198 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.668164 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz"] Jun 11 21:28:50.691849 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.691816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b785c441-58c2-442d-9ba6-4507aca7a946-manager-config\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.692005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.691867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j942m\" (UniqueName: \"kubernetes.io/projected/b785c441-58c2-442d-9ba6-4507aca7a946-kube-api-access-j942m\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.692005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.691908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b785c441-58c2-442d-9ba6-4507aca7a946-metrics-cert\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.692005 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.691942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b785c441-58c2-442d-9ba6-4507aca7a946-cert\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.792397 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.792361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b785c441-58c2-442d-9ba6-4507aca7a946-manager-config\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.792557 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.792418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j942m\" (UniqueName: \"kubernetes.io/projected/b785c441-58c2-442d-9ba6-4507aca7a946-kube-api-access-j942m\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.792557 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.792439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b785c441-58c2-442d-9ba6-4507aca7a946-metrics-cert\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.792557 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.792475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b785c441-58c2-442d-9ba6-4507aca7a946-cert\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.793032 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.793001 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b785c441-58c2-442d-9ba6-4507aca7a946-manager-config\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.795160 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.795138 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b785c441-58c2-442d-9ba6-4507aca7a946-cert\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.795264 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.795184 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b785c441-58c2-442d-9ba6-4507aca7a946-metrics-cert\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.802202 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.802180 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j942m\" (UniqueName: \"kubernetes.io/projected/b785c441-58c2-442d-9ba6-4507aca7a946-kube-api-access-j942m\") pod \"lws-controller-manager-56b9fd76f8-lhjlz\" (UID: \"b785c441-58c2-442d-9ba6-4507aca7a946\") " pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:50.963094 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:50.963058 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:28:51.097272 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:51.097246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz"] Jun 11 21:28:51.099608 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:28:51.099578 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb785c441_58c2_442d_9ba6_4507aca7a946.slice/crio-8343800d23bec0f3b77ffc0e27c590a87b1e31222db61cdb772daae325e12dc6 WatchSource:0}: Error finding container 8343800d23bec0f3b77ffc0e27c590a87b1e31222db61cdb772daae325e12dc6: Status 404 returned error can't find the container with id 8343800d23bec0f3b77ffc0e27c590a87b1e31222db61cdb772daae325e12dc6 Jun 11 21:28:51.503643 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:28:51.503609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" event={"ID":"b785c441-58c2-442d-9ba6-4507aca7a946","Type":"ContainerStarted","Data":"8343800d23bec0f3b77ffc0e27c590a87b1e31222db61cdb772daae325e12dc6"} Jun 11 21:29:00.541013 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:00.540972 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" event={"ID":"b785c441-58c2-442d-9ba6-4507aca7a946","Type":"ContainerStarted","Data":"baf8cd07e186d3111899a4262b8a4774994ba13dad04d8254e760c4b88d12705"} Jun 11 21:29:00.541463 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:00.541098 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:29:00.559075 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:00.559020 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" podStartSLOduration=1.6662486269999999 podStartE2EDuration="10.55900044s" totalImagesPullingTime="8.892751813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:00.558044473 +0000 UTC m=+512.502581837" watchObservedRunningTime="2026-06-11 21:29:00.55900044 +0000 UTC m=+512.503537821" Jun 11 21:29:02.440989 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:02.440948 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:02.537255 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:02.537218 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.089953 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.089907 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.334088 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.334053 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.435774 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.435673 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.465826 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.465800 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9"] Jun 11 21:29:03.469491 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.469473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.472341 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.472319 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 21:29:03.472341 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.472330 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qrt99\"" Jun 11 21:29:03.472341 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.472339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 21:29:03.472548 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.472499 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 21:29:03.472680 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.472660 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 21:29:03.484866 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.484823 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9"] Jun 11 21:29:03.579230 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.579180 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.611237 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.611199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.611449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.611254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-tmp\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.611449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.611322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-manifests\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.611449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.611360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bxs\" (UniqueName: \"kubernetes.io/projected/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-kube-api-access-b2bxs\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.611449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.611381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.680964 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.680927 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.712071 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.712035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-tmp\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.712214 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.712084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-manifests\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.712214 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.712138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bxs\" (UniqueName: \"kubernetes.io/projected/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-kube-api-access-b2bxs\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.712214 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.712163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.712629 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.712260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.712629 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.712602 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-manifests\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.714543 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.714518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-tmp\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.714912 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.714881 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.714912 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.714896 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-webhook-cert\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.723992 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.723963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bxs\" (UniqueName: \"kubernetes.io/projected/fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a-kube-api-access-b2bxs\") pod \"opendatahub-operator-controller-manager-75f49467f8-svkl9\" (UID: \"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a\") " pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.781093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.781061 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:03.792443 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.792330 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.879928 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.879858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:03.919569 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.919543 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9"] Jun 11 21:29:03.921719 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:29:03.921693 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe96fa0f_ef1c_4b43_8370_4f2c0c86b24a.slice/crio-a199a027a18edc09647b06e242c6367ee959b465e21b7c36c4a03184e8d0e435 WatchSource:0}: Error finding container a199a027a18edc09647b06e242c6367ee959b465e21b7c36c4a03184e8d0e435: Status 404 returned error can't find the container with id a199a027a18edc09647b06e242c6367ee959b465e21b7c36c4a03184e8d0e435 Jun 11 21:29:03.978679 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:03.978578 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:04.078861 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:04.078818 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:04.561391 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:04.561339 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" event={"ID":"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a","Type":"ContainerStarted","Data":"a199a027a18edc09647b06e242c6367ee959b465e21b7c36c4a03184e8d0e435"} Jun 11 21:29:07.480934 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:07.480892 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:07.578612 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:07.578577 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" event={"ID":"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a","Type":"ContainerStarted","Data":"53e517446eab3bbaaed4970f3d6c99095f4a7a0bb9cd6973cc2f601d2c19a073"} Jun 11 21:29:07.970405 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:07.970370 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:08.584390 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:08.584350 2563 generic.go:356] "Generic (PLEG): container finished" podID="fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a" containerID="53e517446eab3bbaaed4970f3d6c99095f4a7a0bb9cd6973cc2f601d2c19a073" exitCode=0 Jun 11 21:29:08.584827 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:08.584438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" event={"ID":"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a","Type":"ContainerDied","Data":"53e517446eab3bbaaed4970f3d6c99095f4a7a0bb9cd6973cc2f601d2c19a073"} Jun 11 21:29:09.591342 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:09.591302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" event={"ID":"fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a","Type":"ContainerStarted","Data":"6ea5ceb5c38d43dd5524dbe3cd04dbebd00918a36e89dcc9c8b3528434e80673"} Jun 11 21:29:09.591726 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:09.591412 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:09.616122 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:09.616071 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" podStartSLOduration=2.28597839 podStartE2EDuration="6.616056833s" totalImagesPullingTime="3.272371668s" totalInitContainerRuntime="1.057706775s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:09.614128424 +0000 UTC m=+521.558665804" watchObservedRunningTime="2026-06-11 21:29:09.616056833 +0000 UTC m=+521.560594214" Jun 11 21:29:11.548648 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:11.548615 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56b9fd76f8-lhjlz" Jun 11 21:29:18.126200 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:18.126116 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:20.598706 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:20.598669 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75f49467f8-svkl9" Jun 11 21:29:22.330262 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:22.330190 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:22.438675 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:22.438636 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:22.709528 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:22.709491 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:22.802997 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:22.802960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:23.072103 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.072029 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz"] Jun 11 21:29:23.118686 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.118648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:23.140432 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.140401 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz"] Jun 11 21:29:23.140610 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.140525 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.143217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.143193 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 21:29:23.143449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.143328 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 21:29:23.143449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.143356 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 21:29:23.143449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.143359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 21:29:23.143449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.143442 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zwvxz\"" Jun 11 21:29:23.210171 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.210138 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:23.288413 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.288380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzcf7\" (UniqueName: \"kubernetes.io/projected/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-kube-api-access-jzcf7\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.288582 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.288427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-tmp\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.288582 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.288497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-tls-certs\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.389676 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.389594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-tls-certs\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.389676 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.389652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcf7\" (UniqueName: \"kubernetes.io/projected/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-kube-api-access-jzcf7\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.390093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.389688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-tmp\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.392031 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.392010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-tmp\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.392240 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.392221 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-tls-certs\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.398238 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.398215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcf7\" (UniqueName: \"kubernetes.io/projected/fcb5a617-adfa-4cfb-bbf5-a3a596439bd3-kube-api-access-jzcf7\") pod \"kube-auth-proxy-8bb5d69dd-jptzz\" (UID: \"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3\") " pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.431753 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.431718 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:23.450508 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.450484 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" Jun 11 21:29:23.559202 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.559164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:23.634304 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.634258 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz"] Jun 11 21:29:23.636965 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:29:23.636937 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb5a617_adfa_4cfb_bbf5_a3a596439bd3.slice/crio-9df590f7ec6f4b2da9a82003e30b2a83d302633f47c4c1f0fc9fd16a10d94393 WatchSource:0}: Error finding container 9df590f7ec6f4b2da9a82003e30b2a83d302633f47c4c1f0fc9fd16a10d94393: Status 404 returned error can't find the container with id 9df590f7ec6f4b2da9a82003e30b2a83d302633f47c4c1f0fc9fd16a10d94393 Jun 11 21:29:23.652449 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.652423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" event={"ID":"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3","Type":"ContainerStarted","Data":"9df590f7ec6f4b2da9a82003e30b2a83d302633f47c4c1f0fc9fd16a10d94393"} Jun 11 21:29:23.860775 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:23.860743 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:26.670033 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:26.669999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" event={"ID":"fcb5a617-adfa-4cfb-bbf5-a3a596439bd3","Type":"ContainerStarted","Data":"5df0b4bd1dc2f1d25ca3723bccf3703777d246dbd589d6298fb88df969d586eb"} Jun 11 21:29:26.685935 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:26.685881 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8bb5d69dd-jptzz" podStartSLOduration=0.864436084 podStartE2EDuration="3.685865203s" totalImagesPullingTime="2.821429119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:29:26.68473174 +0000 UTC m=+538.629269144" watchObservedRunningTime="2026-06-11 21:29:26.685865203 +0000 UTC m=+538.630402584" Jun 11 21:29:33.527332 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:33.527268 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:33.615804 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:33.615757 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:34.134994 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:34.134947 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:34.240087 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:34.240055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:34.363088 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:34.363050 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:34.888856 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:34.888819 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:35.003148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:35.003117 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:35.133044 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:35.133011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:35.703305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:35.703256 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:35.828193 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:35.828153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:36.302912 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:36.302876 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:36.855506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:36.855463 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:38.096204 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:38.096167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:38.728847 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:38.728812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:47.605602 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:47.605566 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:47.700516 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:47.700482 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:48.238524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:48.238478 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:48.771303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:48.771253 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:48.872476 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:48.872437 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:51.838935 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:51.838897 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:51.939042 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:51.939011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:52.143338 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:52.143245 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:52.246198 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:52.246155 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:52.363820 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:52.363778 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:29:53.313535 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:29:53.313499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:09.565660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:09.565620 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:15.740524 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:15.740491 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:15.845048 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:15.845002 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:17.885247 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:17.885207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:17.934293 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:17.934240 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:24.012175 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:24.012122 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:24.110194 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:24.110153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:24.172476 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:24.172434 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:24.920093 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:24.920055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:25.123726 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:25.123693 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:25.232697 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:25.232666 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:28.470123 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:28.470094 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:30:28.474817 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:28.474788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:30:42.118217 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:42.118182 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:42.179807 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:42.179768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:44.616159 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:44.616123 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:44.674664 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:44.674625 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:44.770234 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:44.770194 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:44.820972 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:44.820930 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:45.366668 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:45.366570 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:52.662846 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:52.662807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:53.258895 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:53.258853 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:55.474115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:55.474077 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:55.522415 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:55.522377 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:55.574432 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:55.574397 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:30:58.081905 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:30:58.081870 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:00.193222 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:00.193187 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:00.288972 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:00.288932 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:00.673711 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:00.673675 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:01.717443 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:01.717407 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:03.325206 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:03.325160 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:04.691532 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.691492 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz"] Jun 11 21:31:04.694972 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.694956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:04.697589 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.697565 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 21:31:04.697836 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.697815 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 21:31:04.697945 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.697856 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nn7cz\"" Jun 11 21:31:04.706421 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.706398 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz"] Jun 11 21:31:04.793305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.793242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6np7\" (UniqueName: \"kubernetes.io/projected/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-kube-api-access-r6np7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:04.793305 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.793308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:04.894810 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.894771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6np7\" (UniqueName: \"kubernetes.io/projected/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-kube-api-access-r6np7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:04.894810 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.894812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:04.895162 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.895146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:04.905195 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:04.905171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6np7\" (UniqueName: \"kubernetes.io/projected/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-kube-api-access-r6np7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:05.005816 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:05.005777 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:05.148149 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:05.148122 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz"] Jun 11 21:31:05.150392 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:31:05.150362 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc7f1ae_afc0_4455_b9dd_8266fc7d2bc0.slice/crio-f6361e25fadee70988a71c0a9439471e0ff97b9abbbf9333188ef41717673bc2 WatchSource:0}: Error finding container f6361e25fadee70988a71c0a9439471e0ff97b9abbbf9333188ef41717673bc2: Status 404 returned error can't find the container with id f6361e25fadee70988a71c0a9439471e0ff97b9abbbf9333188ef41717673bc2 Jun 11 21:31:05.152849 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:05.152833 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:31:05.263158 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:05.263069 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:06.116450 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:06.116411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" event={"ID":"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0","Type":"ContainerStarted","Data":"f6361e25fadee70988a71c0a9439471e0ff97b9abbbf9333188ef41717673bc2"} Jun 11 21:31:07.215704 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:07.215674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:08.267692 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:08.267654 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:08.367798 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:08.367760 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:08.672264 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:08.672175 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:08.727261 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:08.727227 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:12.146323 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:12.146268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" event={"ID":"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0","Type":"ContainerStarted","Data":"36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd"} Jun 11 21:31:12.146748 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:12.146401 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:12.166270 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:12.166185 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" podStartSLOduration=1.37008686 podStartE2EDuration="8.166168953s" totalImagesPullingTime="6.796082093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:12.164662237 +0000 UTC m=+644.109199620" watchObservedRunningTime="2026-06-11 21:31:12.166168953 +0000 UTC m=+644.110706334" Jun 11 21:31:12.475969 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:12.475923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:12.574993 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:12.574955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:15.039793 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:15.039756 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:15.184758 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:15.184723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:16.276525 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:16.276488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:16.331011 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:16.330973 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:22.034161 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:22.034123 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:22.131608 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:22.131567 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:23.105488 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:23.105439 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:23.154583 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:23.154554 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:23.181416 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:23.181382 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:24.846905 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.846860 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz"] Jun 11 21:31:24.847406 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.847132 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" containerName="manager" containerID="cri-o://36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd" gracePeriod=2 Jun 11 21:31:24.855138 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:24.855094 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:24.855314 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.855229 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz"] Jun 11 21:31:24.892441 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.892407 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2"] Jun 11 21:31:24.892799 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.892785 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" containerName="manager" Jun 11 21:31:24.892872 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.892801 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" containerName="manager" Jun 11 21:31:24.893109 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.892872 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" containerName="manager" Jun 11 21:31:24.895821 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.895797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:24.899961 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:24.899930 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" is forbidden: User \"system:node:ip-10-0-138-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-17.ec2.internal' and this object" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:24.909622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.909591 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh"] Jun 11 21:31:24.913132 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.913106 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2"] Jun 11 21:31:24.913383 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.913211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" Jun 11 21:31:24.916066 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.916044 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hq4zl\"" Jun 11 21:31:24.931928 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.931889 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh"] Jun 11 21:31:24.961683 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:24.961592 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" is forbidden: User \"system:node:ip-10-0-138-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-17.ec2.internal' and this object" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:24.984176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.984143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrs2\" (UniqueName: \"kubernetes.io/projected/12799eac-c13d-456f-a85a-f365e0e829af-kube-api-access-ttrs2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g22q2\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:24.984176 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.984179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm82x\" (UniqueName: \"kubernetes.io/projected/393cd342-d7fb-47f2-a84b-96f1ff618087-kube-api-access-dm82x\") pod \"limitador-operator-controller-manager-859d7b78bd-hzxnh\" (UID: \"393cd342-d7fb-47f2-a84b-96f1ff618087\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" Jun 11 21:31:24.984422 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:24.984217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12799eac-c13d-456f-a85a-f365e0e829af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g22q2\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:25.084786 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.084757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12799eac-c13d-456f-a85a-f365e0e829af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g22q2\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:25.084922 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.084867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrs2\" (UniqueName: \"kubernetes.io/projected/12799eac-c13d-456f-a85a-f365e0e829af-kube-api-access-ttrs2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g22q2\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:25.084922 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.084894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm82x\" (UniqueName: \"kubernetes.io/projected/393cd342-d7fb-47f2-a84b-96f1ff618087-kube-api-access-dm82x\") pod \"limitador-operator-controller-manager-859d7b78bd-hzxnh\" (UID: \"393cd342-d7fb-47f2-a84b-96f1ff618087\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" Jun 11 21:31:25.085196 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.085174 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12799eac-c13d-456f-a85a-f365e0e829af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g22q2\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:25.088612 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.088591 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:25.091003 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:25.090979 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" is forbidden: User \"system:node:ip-10-0-138-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-17.ec2.internal' and this object" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:25.094930 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.094908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrs2\" (UniqueName: \"kubernetes.io/projected/12799eac-c13d-456f-a85a-f365e0e829af-kube-api-access-ttrs2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g22q2\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:25.095042 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.095018 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm82x\" (UniqueName: \"kubernetes.io/projected/393cd342-d7fb-47f2-a84b-96f1ff618087-kube-api-access-dm82x\") pod \"limitador-operator-controller-manager-859d7b78bd-hzxnh\" (UID: \"393cd342-d7fb-47f2-a84b-96f1ff618087\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" Jun 11 21:31:25.186266 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.186175 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6np7\" (UniqueName: \"kubernetes.io/projected/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-kube-api-access-r6np7\") pod \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " Jun 11 21:31:25.186266 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.186245 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-extensions-socket-volume\") pod \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\" (UID: \"3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0\") " Jun 11 21:31:25.186750 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.186723 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" (UID: "3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:31:25.188572 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.188550 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-kube-api-access-r6np7" (OuterVolumeSpecName: "kube-api-access-r6np7") pod "3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" (UID: "3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0"). InnerVolumeSpecName "kube-api-access-r6np7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:31:25.209214 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.209179 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" containerID="36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd" exitCode=0 Jun 11 21:31:25.209407 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.209228 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:25.209407 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.209268 2563 scope.go:117] "RemoveContainer" containerID="36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd" Jun 11 21:31:25.211785 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:25.211752 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" is forbidden: User \"system:node:ip-10-0-138-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-17.ec2.internal' and this object" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:25.219012 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.218987 2563 scope.go:117] "RemoveContainer" containerID="36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd" Jun 11 21:31:25.219308 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:25.219274 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd\": container with ID starting with 36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd not found: ID does not exist" containerID="36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd" Jun 11 21:31:25.219364 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.219317 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd"} err="failed to get container status \"36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd\": rpc error: code = NotFound desc = could not find container \"36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd\": container with ID starting with 36525d40399a4530e70107c5c4f6c550c5a23c18baf1a4f20532b2d9c20ce5fd not found: ID does not exist" Jun 11 21:31:25.220234 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:25.220215 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" is forbidden: User \"system:node:ip-10-0-138-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-17.ec2.internal' and this object" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:25.223382 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.223363 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:25.229807 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.229790 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" Jun 11 21:31:25.287748 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.287186 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6np7\" (UniqueName: \"kubernetes.io/projected/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-kube-api-access-r6np7\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:31:25.287748 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.287220 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0-extensions-socket-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:31:25.378160 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.378124 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2"] Jun 11 21:31:25.380514 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:31:25.380488 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12799eac_c13d_456f_a85a_f365e0e829af.slice/crio-78ec71e7ba259d83f5de8900e361a9d8816efd959c383dace8a2c8034db41457 WatchSource:0}: Error finding container 78ec71e7ba259d83f5de8900e361a9d8816efd959c383dace8a2c8034db41457: Status 404 returned error can't find the container with id 78ec71e7ba259d83f5de8900e361a9d8816efd959c383dace8a2c8034db41457 Jun 11 21:31:25.388515 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:25.388466 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh"] Jun 11 21:31:25.390615 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:31:25.390588 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393cd342_d7fb_47f2_a84b_96f1ff618087.slice/crio-e90359c14e932be5ff626a02159bc74547606380ff1248b25e14253b46824ab5 WatchSource:0}: Error finding container e90359c14e932be5ff626a02159bc74547606380ff1248b25e14253b46824ab5: Status 404 returned error can't find the container with id e90359c14e932be5ff626a02159bc74547606380ff1248b25e14253b46824ab5 Jun 11 21:31:26.217222 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:26.217179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" event={"ID":"393cd342-d7fb-47f2-a84b-96f1ff618087","Type":"ContainerStarted","Data":"e90359c14e932be5ff626a02159bc74547606380ff1248b25e14253b46824ab5"} Jun 11 21:31:26.219064 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:26.219035 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" event={"ID":"12799eac-c13d-456f-a85a-f365e0e829af","Type":"ContainerStarted","Data":"f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d"} Jun 11 21:31:26.219224 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:26.219080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" event={"ID":"12799eac-c13d-456f-a85a-f365e0e829af","Type":"ContainerStarted","Data":"78ec71e7ba259d83f5de8900e361a9d8816efd959c383dace8a2c8034db41457"} Jun 11 21:31:26.219224 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:26.219182 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:26.244459 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:26.244411 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7l8fz\" is forbidden: User \"system:node:ip-10-0-138-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-17.ec2.internal' and this object" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7l8fz" Jun 11 21:31:26.245448 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:26.245398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" podStartSLOduration=2.245379717 podStartE2EDuration="2.245379717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:26.242265484 +0000 UTC m=+658.186802866" watchObservedRunningTime="2026-06-11 21:31:26.245379717 +0000 UTC m=+658.189917099" Jun 11 21:31:26.503557 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:26.503467 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0" path="/var/lib/kubelet/pods/3bc7f1ae-afc0-4455-b9dd-8266fc7d2bc0/volumes" Jun 11 21:31:26.906592 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:26.906547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:27.005234 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:27.005200 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:27.113856 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:27.113761 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:27.207111 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:27.207074 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:27.225341 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:27.225299 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" event={"ID":"393cd342-d7fb-47f2-a84b-96f1ff618087","Type":"ContainerStarted","Data":"867deeb463fb199b3442a76fcc382f9d195b61713b278231614f78114c117607"} Jun 11 21:31:27.225742 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:27.225469 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" Jun 11 21:31:27.252488 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:27.252427 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" podStartSLOduration=1.961001033 podStartE2EDuration="3.252407253s" totalImagesPullingTime="1.29140622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:27.251126001 +0000 UTC m=+659.195663383" watchObservedRunningTime="2026-06-11 21:31:27.252407253 +0000 UTC m=+659.196944634" Jun 11 21:31:28.686858 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:28.686821 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:28.783194 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:28.783102 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:33.807856 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:33.807815 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:33.906653 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:33.906615 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:36.911292 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:36.911226 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:37.011898 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:37.011858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:37.227597 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:37.227565 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:38.232958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:38.232928 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hzxnh" Jun 11 21:31:40.589513 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.589473 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2"] Jun 11 21:31:40.589949 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.589700 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" podUID="12799eac-c13d-456f-a85a-f365e0e829af" containerName="manager" containerID="cri-o://f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d" gracePeriod=10 Jun 11 21:31:40.839459 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.839426 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt"] Jun 11 21:31:40.844506 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.844436 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:40.846527 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.846499 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:40.866838 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.866812 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt"] Jun 11 21:31:40.931512 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.931486 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12799eac-c13d-456f-a85a-f365e0e829af-extensions-socket-volume\") pod \"12799eac-c13d-456f-a85a-f365e0e829af\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " Jun 11 21:31:40.931665 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.931542 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttrs2\" (UniqueName: \"kubernetes.io/projected/12799eac-c13d-456f-a85a-f365e0e829af-kube-api-access-ttrs2\") pod \"12799eac-c13d-456f-a85a-f365e0e829af\" (UID: \"12799eac-c13d-456f-a85a-f365e0e829af\") " Jun 11 21:31:40.931829 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.931810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dxs\" (UniqueName: \"kubernetes.io/projected/133db14a-862d-4cbe-b6e4-c8db8143b72d-kube-api-access-h8dxs\") pod \"kuadrant-operator-controller-manager-86878c769f-9zpmt\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:40.931911 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.931879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/133db14a-862d-4cbe-b6e4-c8db8143b72d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zpmt\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:40.932186 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.931927 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12799eac-c13d-456f-a85a-f365e0e829af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "12799eac-c13d-456f-a85a-f365e0e829af" (UID: "12799eac-c13d-456f-a85a-f365e0e829af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:31:40.933862 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.933835 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12799eac-c13d-456f-a85a-f365e0e829af-kube-api-access-ttrs2" (OuterVolumeSpecName: "kube-api-access-ttrs2") pod "12799eac-c13d-456f-a85a-f365e0e829af" (UID: "12799eac-c13d-456f-a85a-f365e0e829af"). InnerVolumeSpecName "kube-api-access-ttrs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:31:40.938767 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:40.938743 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:41.013613 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.013580 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:41.032638 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.032602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dxs\" (UniqueName: \"kubernetes.io/projected/133db14a-862d-4cbe-b6e4-c8db8143b72d-kube-api-access-h8dxs\") pod \"kuadrant-operator-controller-manager-86878c769f-9zpmt\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:41.032820 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.032666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/133db14a-862d-4cbe-b6e4-c8db8143b72d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zpmt\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:41.032820 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.032751 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12799eac-c13d-456f-a85a-f365e0e829af-extensions-socket-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:31:41.032820 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.032767 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttrs2\" (UniqueName: \"kubernetes.io/projected/12799eac-c13d-456f-a85a-f365e0e829af-kube-api-access-ttrs2\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:31:41.033057 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.033039 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/133db14a-862d-4cbe-b6e4-c8db8143b72d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zpmt\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:41.041949 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.041917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dxs\" (UniqueName: \"kubernetes.io/projected/133db14a-862d-4cbe-b6e4-c8db8143b72d-kube-api-access-h8dxs\") pod \"kuadrant-operator-controller-manager-86878c769f-9zpmt\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:41.154881 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.154780 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:41.294206 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.294180 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt"] Jun 11 21:31:41.294307 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.294209 2563 generic.go:356] "Generic (PLEG): container finished" podID="12799eac-c13d-456f-a85a-f365e0e829af" containerID="f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d" exitCode=0 Jun 11 21:31:41.294307 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.294245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" event={"ID":"12799eac-c13d-456f-a85a-f365e0e829af","Type":"ContainerDied","Data":"f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d"} Jun 11 21:31:41.294402 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.294310 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" event={"ID":"12799eac-c13d-456f-a85a-f365e0e829af","Type":"ContainerDied","Data":"78ec71e7ba259d83f5de8900e361a9d8816efd959c383dace8a2c8034db41457"} Jun 11 21:31:41.294402 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.294339 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2" Jun 11 21:31:41.294473 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.294341 2563 scope.go:117] "RemoveContainer" containerID="f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d" Jun 11 21:31:41.297517 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:31:41.297493 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133db14a_862d_4cbe_b6e4_c8db8143b72d.slice/crio-765241cec321bd1c4c0c0d9488aaeee9bae53d8a490d9111a2345383eef2bdea WatchSource:0}: Error finding container 765241cec321bd1c4c0c0d9488aaeee9bae53d8a490d9111a2345383eef2bdea: Status 404 returned error can't find the container with id 765241cec321bd1c4c0c0d9488aaeee9bae53d8a490d9111a2345383eef2bdea Jun 11 21:31:41.304661 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.304635 2563 scope.go:117] "RemoveContainer" containerID="f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d" Jun 11 21:31:41.304966 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:31:41.304949 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d\": container with ID starting with f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d not found: ID does not exist" containerID="f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d" Jun 11 21:31:41.305033 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.304975 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d"} err="failed to get container status \"f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d\": rpc error: code = NotFound desc = could not find container \"f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d\": container with ID starting with f1688f21f234f91ce7bad561dfefaaf262d78773447c639a73d7c51807b40f5d not found: ID does not exist" Jun 11 21:31:41.320516 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.320449 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2"] Jun 11 21:31:41.322938 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:41.322911 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g22q2"] Jun 11 21:31:42.302082 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:42.302048 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" event={"ID":"133db14a-862d-4cbe-b6e4-c8db8143b72d","Type":"ContainerStarted","Data":"efb855e8860a10ffece1799ae96d1cafd80ee081ded6016b813fc3c57bb9a9b5"} Jun 11 21:31:42.302541 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:42.302101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" event={"ID":"133db14a-862d-4cbe-b6e4-c8db8143b72d","Type":"ContainerStarted","Data":"765241cec321bd1c4c0c0d9488aaeee9bae53d8a490d9111a2345383eef2bdea"} Jun 11 21:31:42.302541 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:42.302170 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:42.319900 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:42.319851 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" podStartSLOduration=2.319836219 podStartE2EDuration="2.319836219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:42.319048594 +0000 UTC m=+674.263585976" watchObservedRunningTime="2026-06-11 21:31:42.319836219 +0000 UTC m=+674.264373600" Jun 11 21:31:42.500631 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:42.500592 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12799eac-c13d-456f-a85a-f365e0e829af" path="/var/lib/kubelet/pods/12799eac-c13d-456f-a85a-f365e0e829af/volumes" Jun 11 21:31:43.963057 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:43.963021 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:44.063702 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:44.063655 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:44.641647 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:44.641607 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:44.694210 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:44.694168 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:45.042157 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:45.042107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:45.095641 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:45.095604 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:47.637711 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:47.637670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:47.735026 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:47.734989 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:48.233000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:48.232948 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:48.282459 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:48.282419 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:53.037566 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:53.037527 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:53.094445 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:53.094407 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:53.309214 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:53.309125 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:31:57.111092 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:57.111058 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:57.790135 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:57.790087 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:59.649666 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:59.649619 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:31:59.748414 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:31:59.748369 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:11.407057 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:11.407007 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:11.513691 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:11.513645 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:11.566619 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:11.566575 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:12.207308 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.207251 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ss7bn"] Jun 11 21:32:12.207664 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.207649 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12799eac-c13d-456f-a85a-f365e0e829af" containerName="manager" Jun 11 21:32:12.207711 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.207666 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="12799eac-c13d-456f-a85a-f365e0e829af" containerName="manager" Jun 11 21:32:12.207745 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.207735 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="12799eac-c13d-456f-a85a-f365e0e829af" containerName="manager" Jun 11 21:32:12.212870 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.212845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ss7bn" Jun 11 21:32:12.215417 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.215387 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4lm2\"" Jun 11 21:32:12.216969 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.216945 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ss7bn"] Jun 11 21:32:12.240586 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.240550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:12.315421 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.315378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcln\" (UniqueName: \"kubernetes.io/projected/cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf-kube-api-access-6xcln\") pod \"authorino-58cd955675-ss7bn\" (UID: \"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf\") " pod="kuadrant-system/authorino-58cd955675-ss7bn" Jun 11 21:32:12.339111 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.339076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:12.416259 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.416218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcln\" (UniqueName: \"kubernetes.io/projected/cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf-kube-api-access-6xcln\") pod \"authorino-58cd955675-ss7bn\" (UID: \"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf\") " pod="kuadrant-system/authorino-58cd955675-ss7bn" Jun 11 21:32:12.427226 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.427191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcln\" (UniqueName: \"kubernetes.io/projected/cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf-kube-api-access-6xcln\") pod \"authorino-58cd955675-ss7bn\" (UID: \"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf\") " pod="kuadrant-system/authorino-58cd955675-ss7bn" Jun 11 21:32:12.535191 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.535088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ss7bn" Jun 11 21:32:12.667128 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:12.667099 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ss7bn"] Jun 11 21:32:12.669176 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:32:12.669150 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfcf53ca_47d0_446c_b3e4_f8c13c21ffcf.slice/crio-3b51db1d571a00e6d55d057ed767d6a0ace098b14ec808a44bc9fd1f818b9038 WatchSource:0}: Error finding container 3b51db1d571a00e6d55d057ed767d6a0ace098b14ec808a44bc9fd1f818b9038: Status 404 returned error can't find the container with id 3b51db1d571a00e6d55d057ed767d6a0ace098b14ec808a44bc9fd1f818b9038 Jun 11 21:32:13.453754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:13.453690 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ss7bn" event={"ID":"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf","Type":"ContainerStarted","Data":"3b51db1d571a00e6d55d057ed767d6a0ace098b14ec808a44bc9fd1f818b9038"} Jun 11 21:32:16.471585 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:16.471552 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ss7bn" event={"ID":"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf","Type":"ContainerStarted","Data":"d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc"} Jun 11 21:32:16.487089 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:16.487029 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ss7bn" podStartSLOduration=1.144561238 podStartE2EDuration="4.487013202s" totalImagesPullingTime="3.342451964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:32:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:32:16.485469169 +0000 UTC m=+708.430006550" watchObservedRunningTime="2026-06-11 21:32:16.487013202 +0000 UTC m=+708.431550582" Jun 11 21:32:17.934340 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:17.934303 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ss7bn"] Jun 11 21:32:18.486928 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:18.486866 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ss7bn" podUID="cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf" containerName="authorino" containerID="cri-o://d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc" gracePeriod=30 Jun 11 21:32:18.742930 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:18.742867 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ss7bn" Jun 11 21:32:18.882379 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:18.882343 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xcln\" (UniqueName: \"kubernetes.io/projected/cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf-kube-api-access-6xcln\") pod \"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf\" (UID: \"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf\") " Jun 11 21:32:18.884611 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:18.884584 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf-kube-api-access-6xcln" (OuterVolumeSpecName: "kube-api-access-6xcln") pod "cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf" (UID: "cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf"). InnerVolumeSpecName "kube-api-access-6xcln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:32:18.983133 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:18.983096 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xcln\" (UniqueName: \"kubernetes.io/projected/cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf-kube-api-access-6xcln\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:32:19.492183 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.492144 2563 generic.go:356] "Generic (PLEG): container finished" podID="cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf" containerID="d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc" exitCode=0 Jun 11 21:32:19.492436 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.492189 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ss7bn" Jun 11 21:32:19.492436 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.492192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ss7bn" event={"ID":"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf","Type":"ContainerDied","Data":"d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc"} Jun 11 21:32:19.492436 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.492327 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ss7bn" event={"ID":"cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf","Type":"ContainerDied","Data":"3b51db1d571a00e6d55d057ed767d6a0ace098b14ec808a44bc9fd1f818b9038"} Jun 11 21:32:19.492436 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.492354 2563 scope.go:117] "RemoveContainer" containerID="d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc" Jun 11 21:32:19.501256 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.501237 2563 scope.go:117] "RemoveContainer" containerID="d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc" Jun 11 21:32:19.501546 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:32:19.501528 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc\": container with ID starting with d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc not found: ID does not exist" containerID="d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc" Jun 11 21:32:19.501596 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.501554 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc"} err="failed to get container status \"d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc\": rpc error: code = NotFound desc = could not find container \"d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc\": container with ID starting with d5b1cb5d7d65a735a4923b30291d8b209cc092c6b3ed4ab3f666d82337eff4dc not found: ID does not exist" Jun 11 21:32:19.512532 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.512511 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ss7bn"] Jun 11 21:32:19.515934 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:19.515910 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ss7bn"] Jun 11 21:32:20.500463 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:20.500420 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf" path="/var/lib/kubelet/pods/cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf/volumes" Jun 11 21:32:30.477829 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:30.477790 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:40.177864 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:40.177825 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:40.272071 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:40.272029 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:32:40.411867 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:32:40.411826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:03.877233 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:03.877196 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:03.977713 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:03.977634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:04.280787 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.280754 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:33:04.281179 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.281165 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf" containerName="authorino" Jun 11 21:33:04.281227 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.281181 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf" containerName="authorino" Jun 11 21:33:04.281265 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.281254 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfcf53ca-47d0-446c-b3e4-f8c13c21ffcf" containerName="authorino" Jun 11 21:33:04.286126 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.286108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:04.288554 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.288528 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 21:33:04.288712 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.288600 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-kflwj\"" Jun 11 21:33:04.288712 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.288617 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 21:33:04.289670 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.289646 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 21:33:04.292243 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.292218 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:33:04.393669 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.393634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ksh5\" (UniqueName: \"kubernetes.io/projected/e5a4b59c-b8df-4ab3-ba7b-295b9ee87471-kube-api-access-7ksh5\") pod \"maas-keycloak-0\" (UID: \"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:04.494541 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.494502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ksh5\" (UniqueName: \"kubernetes.io/projected/e5a4b59c-b8df-4ab3-ba7b-295b9ee87471-kube-api-access-7ksh5\") pod \"maas-keycloak-0\" (UID: \"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:04.502800 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.502761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ksh5\" (UniqueName: \"kubernetes.io/projected/e5a4b59c-b8df-4ab3-ba7b-295b9ee87471-kube-api-access-7ksh5\") pod \"maas-keycloak-0\" (UID: \"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:04.597646 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.597543 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:04.728881 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:04.728856 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:33:04.730603 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:33:04.730580 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a4b59c_b8df_4ab3_ba7b_295b9ee87471.slice/crio-93fd501c17b1c4979c46d3b86514b93925328fd0ec961f49e6d80d2182b4ea86 WatchSource:0}: Error finding container 93fd501c17b1c4979c46d3b86514b93925328fd0ec961f49e6d80d2182b4ea86: Status 404 returned error can't find the container with id 93fd501c17b1c4979c46d3b86514b93925328fd0ec961f49e6d80d2182b4ea86 Jun 11 21:33:05.700360 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:05.700323 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471","Type":"ContainerStarted","Data":"93fd501c17b1c4979c46d3b86514b93925328fd0ec961f49e6d80d2182b4ea86"} Jun 11 21:33:11.735323 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:11.735198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471","Type":"ContainerStarted","Data":"fa003728468bc567105790fdc8fbc13feed59a0d2712a265a517e5f3bdae967c"} Jun 11 21:33:12.597950 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:12.597912 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:12.599465 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:12.599429 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:13.598457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:13.598405 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:14.598396 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:14.598334 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:14.598683 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:14.598551 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:15.598548 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:15.598485 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:16.599058 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:16.598986 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:17.598897 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:17.598821 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:18.598261 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:18.598208 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:19.598343 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:19.598271 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:20.598132 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:20.598077 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:21.598355 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:21.598275 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:22.598263 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:22.598213 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:23.599004 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:23.598944 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 21:33:24.696989 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:24.696946 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:24.711793 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:24.711746 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:33:24.715613 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:24.715531 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=13.960922258 podStartE2EDuration="20.71551134s" totalImagesPullingTime="6.754589082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:11.75138055 +0000 UTC m=+763.695917931" watchObservedRunningTime="2026-06-11 21:33:24.71551134 +0000 UTC m=+776.660048723" Jun 11 21:33:34.702463 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:34.702415 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 21:33:35.421763 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:35.421719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:36.325655 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:36.325611 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:41.044174 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.044143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:41.056531 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.056501 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cbf8594fd-488n7"] Jun 11 21:33:41.063886 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.063860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.066424 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.066399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 21:33:41.067473 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.067455 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 21:33:41.067595 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.067544 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d7k2k\"" Jun 11 21:33:41.073001 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.072969 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cbf8594fd-488n7"] Jun 11 21:33:41.140856 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.140818 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:41.169781 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.169740 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnfm\" (UniqueName: \"kubernetes.io/projected/df890442-8544-452b-bf31-d2af4e20486e-kube-api-access-bxnfm\") pod \"maas-controller-5cbf8594fd-488n7\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.169958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.169879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df890442-8544-452b-bf31-d2af4e20486e-webhook-cert\") pod \"maas-controller-5cbf8594fd-488n7\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.207087 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.207054 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:41.270565 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.270530 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnfm\" (UniqueName: \"kubernetes.io/projected/df890442-8544-452b-bf31-d2af4e20486e-kube-api-access-bxnfm\") pod \"maas-controller-5cbf8594fd-488n7\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.270735 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.270644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df890442-8544-452b-bf31-d2af4e20486e-webhook-cert\") pod \"maas-controller-5cbf8594fd-488n7\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.279508 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.279473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df890442-8544-452b-bf31-d2af4e20486e-webhook-cert\") pod \"maas-controller-5cbf8594fd-488n7\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.281684 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.281663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnfm\" (UniqueName: \"kubernetes.io/projected/df890442-8544-452b-bf31-d2af4e20486e-kube-api-access-bxnfm\") pod \"maas-controller-5cbf8594fd-488n7\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.375447 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.375349 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:41.504327 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.504299 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cbf8594fd-488n7"] Jun 11 21:33:41.506599 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:33:41.506568 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf890442_8544_452b_bf31_d2af4e20486e.slice/crio-db4acc58b72fbf4c9b34a5787fd88bd0877d129de11db2a2fef78436153f52af WatchSource:0}: Error finding container db4acc58b72fbf4c9b34a5787fd88bd0877d129de11db2a2fef78436153f52af: Status 404 returned error can't find the container with id db4acc58b72fbf4c9b34a5787fd88bd0877d129de11db2a2fef78436153f52af Jun 11 21:33:41.908543 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:41.908509 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbf8594fd-488n7" event={"ID":"df890442-8544-452b-bf31-d2af4e20486e","Type":"ContainerStarted","Data":"db4acc58b72fbf4c9b34a5787fd88bd0877d129de11db2a2fef78436153f52af"} Jun 11 21:33:44.322948 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:44.322884 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:44.413742 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:44.413707 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:33:44.925717 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:44.925680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbf8594fd-488n7" event={"ID":"df890442-8544-452b-bf31-d2af4e20486e","Type":"ContainerStarted","Data":"cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb"} Jun 11 21:33:44.925904 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:44.925811 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:44.944543 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:44.944470 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cbf8594fd-488n7" podStartSLOduration=1.170582494 podStartE2EDuration="3.944430892s" totalImagesPullingTime="2.773848398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:33:44.94371368 +0000 UTC m=+796.888251062" watchObservedRunningTime="2026-06-11 21:33:44.944430892 +0000 UTC m=+796.888968273" Jun 11 21:33:55.459757 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.459721 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cbf8594fd-488n7"] Jun 11 21:33:55.460241 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.459945 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5cbf8594fd-488n7" podUID="df890442-8544-452b-bf31-d2af4e20486e" containerName="manager" containerID="cri-o://cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb" gracePeriod=30 Jun 11 21:33:55.467107 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.467083 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:55.700361 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.700326 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:55.804464 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.804368 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxnfm\" (UniqueName: \"kubernetes.io/projected/df890442-8544-452b-bf31-d2af4e20486e-kube-api-access-bxnfm\") pod \"df890442-8544-452b-bf31-d2af4e20486e\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " Jun 11 21:33:55.804464 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.804418 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df890442-8544-452b-bf31-d2af4e20486e-webhook-cert\") pod \"df890442-8544-452b-bf31-d2af4e20486e\" (UID: \"df890442-8544-452b-bf31-d2af4e20486e\") " Jun 11 21:33:55.806764 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.806729 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df890442-8544-452b-bf31-d2af4e20486e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "df890442-8544-452b-bf31-d2af4e20486e" (UID: "df890442-8544-452b-bf31-d2af4e20486e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:33:55.806877 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.806766 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df890442-8544-452b-bf31-d2af4e20486e-kube-api-access-bxnfm" (OuterVolumeSpecName: "kube-api-access-bxnfm") pod "df890442-8544-452b-bf31-d2af4e20486e" (UID: "df890442-8544-452b-bf31-d2af4e20486e"). InnerVolumeSpecName "kube-api-access-bxnfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:33:55.905385 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.905346 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxnfm\" (UniqueName: \"kubernetes.io/projected/df890442-8544-452b-bf31-d2af4e20486e-kube-api-access-bxnfm\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:33:55.905385 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.905380 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df890442-8544-452b-bf31-d2af4e20486e-webhook-cert\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:33:55.975748 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.975714 2563 generic.go:356] "Generic (PLEG): container finished" podID="df890442-8544-452b-bf31-d2af4e20486e" containerID="cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb" exitCode=0 Jun 11 21:33:55.975922 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.975754 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cbf8594fd-488n7" Jun 11 21:33:55.975922 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.975763 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbf8594fd-488n7" event={"ID":"df890442-8544-452b-bf31-d2af4e20486e","Type":"ContainerDied","Data":"cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb"} Jun 11 21:33:55.975922 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.975806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cbf8594fd-488n7" event={"ID":"df890442-8544-452b-bf31-d2af4e20486e","Type":"ContainerDied","Data":"db4acc58b72fbf4c9b34a5787fd88bd0877d129de11db2a2fef78436153f52af"} Jun 11 21:33:55.975922 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.975829 2563 scope.go:117] "RemoveContainer" containerID="cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb" Jun 11 21:33:55.986822 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.986803 2563 scope.go:117] "RemoveContainer" containerID="cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb" Jun 11 21:33:55.987089 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:33:55.987070 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb\": container with ID starting with cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb not found: ID does not exist" containerID="cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb" Jun 11 21:33:55.987142 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:55.987098 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb"} err="failed to get container status \"cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb\": rpc error: code = NotFound desc = could not find container \"cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb\": container with ID starting with cda6e5d9b127c723aa3b74d983b418b9f9e8da1828b90ce25b75cfb4837bbabb not found: ID does not exist" Jun 11 21:33:56.000619 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:56.000595 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cbf8594fd-488n7"] Jun 11 21:33:56.006044 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:56.006013 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cbf8594fd-488n7"] Jun 11 21:33:56.500161 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:33:56.500128 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df890442-8544-452b-bf31-d2af4e20486e" path="/var/lib/kubelet/pods/df890442-8544-452b-bf31-d2af4e20486e/volumes" Jun 11 21:34:15.246690 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.246636 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:15.308737 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.308697 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5bf8984b-gb848"] Jun 11 21:34:15.309064 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.309052 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df890442-8544-452b-bf31-d2af4e20486e" containerName="manager" Jun 11 21:34:15.309115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.309066 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="df890442-8544-452b-bf31-d2af4e20486e" containerName="manager" Jun 11 21:34:15.309157 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.309139 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="df890442-8544-452b-bf31-d2af4e20486e" containerName="manager" Jun 11 21:34:15.313590 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.313574 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.316326 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.316299 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 21:34:15.316618 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.316595 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-x68mn\"" Jun 11 21:34:15.321969 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.321945 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5bf8984b-gb848"] Jun 11 21:34:15.379373 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.379343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7st\" (UniqueName: \"kubernetes.io/projected/99e53be6-809c-4bef-b845-24f5c582e559-kube-api-access-pg7st\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.379525 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.379386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.379525 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.379509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99e53be6-809c-4bef-b845-24f5c582e559-openshift-service-ca\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.480387 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.480352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99e53be6-809c-4bef-b845-24f5c582e559-openshift-service-ca\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.480570 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.480439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7st\" (UniqueName: \"kubernetes.io/projected/99e53be6-809c-4bef-b845-24f5c582e559-kube-api-access-pg7st\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.480570 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.480462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.480646 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:34:15.480588 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 21:34:15.480646 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:34:15.480643 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls podName:99e53be6-809c-4bef-b845-24f5c582e559 nodeName:}" failed. No retries permitted until 2026-06-11 21:34:15.98062809 +0000 UTC m=+827.925165452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls") pod "maas-api-5bf8984b-gb848" (UID: "99e53be6-809c-4bef-b845-24f5c582e559") : secret "maas-api-serving-cert" not found Jun 11 21:34:15.481049 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.481030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99e53be6-809c-4bef-b845-24f5c582e559-openshift-service-ca\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.489666 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.489633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7st\" (UniqueName: \"kubernetes.io/projected/99e53be6-809c-4bef-b845-24f5c582e559-kube-api-access-pg7st\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.710143 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.710110 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:15.808248 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.808203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:15.833525 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.833496 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zcpz2"] Jun 11 21:34:15.837115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.837096 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" Jun 11 21:34:15.839648 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.839627 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 21:34:15.847257 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.847234 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zcpz2"] Jun 11 21:34:15.984944 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.984851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6grm\" (UniqueName: \"kubernetes.io/projected/05545275-d313-40f8-abd9-ad07f239f35c-kube-api-access-l6grm\") pod \"payload-pre-processing-579785bc64-zcpz2\" (UID: \"05545275-d313-40f8-abd9-ad07f239f35c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" Jun 11 21:34:15.985096 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:15.985048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:15.985185 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:34:15.985170 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 21:34:15.985272 ip-10-0-138-17 kubenswrapper[2563]: E0611 21:34:15.985261 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls podName:99e53be6-809c-4bef-b845-24f5c582e559 nodeName:}" failed. No retries permitted until 2026-06-11 21:34:16.985246542 +0000 UTC m=+828.929783904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls") pod "maas-api-5bf8984b-gb848" (UID: "99e53be6-809c-4bef-b845-24f5c582e559") : secret "maas-api-serving-cert" not found Jun 11 21:34:16.086578 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:16.086543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6grm\" (UniqueName: \"kubernetes.io/projected/05545275-d313-40f8-abd9-ad07f239f35c-kube-api-access-l6grm\") pod \"payload-pre-processing-579785bc64-zcpz2\" (UID: \"05545275-d313-40f8-abd9-ad07f239f35c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" Jun 11 21:34:16.094136 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:16.094106 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6grm\" (UniqueName: \"kubernetes.io/projected/05545275-d313-40f8-abd9-ad07f239f35c-kube-api-access-l6grm\") pod \"payload-pre-processing-579785bc64-zcpz2\" (UID: \"05545275-d313-40f8-abd9-ad07f239f35c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" Jun 11 21:34:16.148925 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:16.148893 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" Jun 11 21:34:16.214336 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:16.214221 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:34:16.285507 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:16.285476 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-zcpz2"] Jun 11 21:34:16.287509 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:34:16.287480 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05545275_d313_40f8_abd9_ad07f239f35c.slice/crio-69ae26d410ff042b22840da550b95d86738c303bcdc5c436417f5176d470d098 WatchSource:0}: Error finding container 69ae26d410ff042b22840da550b95d86738c303bcdc5c436417f5176d470d098: Status 404 returned error can't find the container with id 69ae26d410ff042b22840da550b95d86738c303bcdc5c436417f5176d470d098 Jun 11 21:34:16.993671 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:16.993628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:16.997333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:16.997277 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99e53be6-809c-4bef-b845-24f5c582e559-maas-api-tls\") pod \"maas-api-5bf8984b-gb848\" (UID: \"99e53be6-809c-4bef-b845-24f5c582e559\") " pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:17.074376 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:17.074336 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" event={"ID":"05545275-d313-40f8-abd9-ad07f239f35c","Type":"ContainerStarted","Data":"69ae26d410ff042b22840da550b95d86738c303bcdc5c436417f5176d470d098"} Jun 11 21:34:17.125210 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:17.125175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:17.303069 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:17.302588 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5bf8984b-gb848"] Jun 11 21:34:18.080874 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:18.080828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5bf8984b-gb848" event={"ID":"99e53be6-809c-4bef-b845-24f5c582e559","Type":"ContainerStarted","Data":"f0f13937a26ccdadaa5681240c4190474eb1460ab2528d7e771619fdb2fa18bf"} Jun 11 21:34:19.088834 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:19.088794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" event={"ID":"05545275-d313-40f8-abd9-ad07f239f35c","Type":"ContainerStarted","Data":"760bdc394c04f635fdd5823a0e7cf1c0c88e0818ca1437175e3d31e5543b9f96"} Jun 11 21:34:19.089303 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:19.088889 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" Jun 11 21:34:19.104664 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:19.104611 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" podStartSLOduration=1.8436985799999999 podStartE2EDuration="4.104588832s" totalImagesPullingTime="2.260890252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:34:19.104022697 +0000 UTC m=+831.048560091" watchObservedRunningTime="2026-06-11 21:34:19.104588832 +0000 UTC m=+831.049126211" Jun 11 21:34:20.096696 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:20.096642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5bf8984b-gb848" event={"ID":"99e53be6-809c-4bef-b845-24f5c582e559","Type":"ContainerStarted","Data":"49a6fc932ee12659f5d5abcab1482ffc395ee7bdeb8cdb0b05a8a2042822aca3"} Jun 11 21:34:20.097121 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:20.096881 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:20.112770 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:20.112720 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5bf8984b-gb848" podStartSLOduration=2.519299128 podStartE2EDuration="5.112705566s" totalImagesPullingTime="2.593406438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:34:20.111991756 +0000 UTC m=+832.056529146" watchObservedRunningTime="2026-06-11 21:34:20.112705566 +0000 UTC m=+832.057242946" Jun 11 21:34:26.107959 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:26.107927 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5bf8984b-gb848" Jun 11 21:34:30.099469 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:34:30.099438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-zcpz2" Jun 11 21:35:28.504587 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:35:28.504511 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:35:28.505079 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:35:28.504593 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:36:30.266181 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:30.266139 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:36:30.266688 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:30.266357 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" containerID="cri-o://fa003728468bc567105790fdc8fbc13feed59a0d2712a265a517e5f3bdae967c" gracePeriod=30 Jun 11 21:36:31.722766 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:31.722731 2563 generic.go:356] "Generic (PLEG): container finished" podID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerID="fa003728468bc567105790fdc8fbc13feed59a0d2712a265a517e5f3bdae967c" exitCode=143 Jun 11 21:36:31.723120 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:31.722803 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471","Type":"ContainerDied","Data":"fa003728468bc567105790fdc8fbc13feed59a0d2712a265a517e5f3bdae967c"} Jun 11 21:36:32.317344 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.317317 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:32.407640 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.407600 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ksh5\" (UniqueName: \"kubernetes.io/projected/e5a4b59c-b8df-4ab3-ba7b-295b9ee87471-kube-api-access-7ksh5\") pod \"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471\" (UID: \"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471\") " Jun 11 21:36:32.409873 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.409848 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5a4b59c-b8df-4ab3-ba7b-295b9ee87471-kube-api-access-7ksh5" (OuterVolumeSpecName: "kube-api-access-7ksh5") pod "e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" (UID: "e5a4b59c-b8df-4ab3-ba7b-295b9ee87471"). InnerVolumeSpecName "kube-api-access-7ksh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:36:32.508880 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.508856 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ksh5\" (UniqueName: \"kubernetes.io/projected/e5a4b59c-b8df-4ab3-ba7b-295b9ee87471-kube-api-access-7ksh5\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:36:32.728586 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.728553 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:32.729000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.728591 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e5a4b59c-b8df-4ab3-ba7b-295b9ee87471","Type":"ContainerDied","Data":"93fd501c17b1c4979c46d3b86514b93925328fd0ec961f49e6d80d2182b4ea86"} Jun 11 21:36:32.729000 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.728654 2563 scope.go:117] "RemoveContainer" containerID="fa003728468bc567105790fdc8fbc13feed59a0d2712a265a517e5f3bdae967c" Jun 11 21:36:32.744591 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.744568 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:36:32.747659 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.747636 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:36:32.769935 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.769869 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:36:32.770251 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.770238 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" Jun 11 21:36:32.770322 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.770253 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" Jun 11 21:36:32.770359 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.770349 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" containerName="keycloak" Jun 11 21:36:32.774706 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.774687 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:32.777164 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.777143 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 21:36:32.777314 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.777197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 21:36:32.777314 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.777217 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-kflwj\"" Jun 11 21:36:32.777314 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.777237 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 21:36:32.777502 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.777485 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 21:36:32.783099 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.783077 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:36:32.912465 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.912423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5547f3e9-d58a-488a-8588-3efb762004b8-test-realms\") pod \"maas-keycloak-0\" (UID: \"5547f3e9-d58a-488a-8588-3efb762004b8\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:32.912624 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:32.912487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt7vt\" (UniqueName: \"kubernetes.io/projected/5547f3e9-d58a-488a-8588-3efb762004b8-kube-api-access-pt7vt\") pod \"maas-keycloak-0\" (UID: \"5547f3e9-d58a-488a-8588-3efb762004b8\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:33.013745 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.013704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt7vt\" (UniqueName: \"kubernetes.io/projected/5547f3e9-d58a-488a-8588-3efb762004b8-kube-api-access-pt7vt\") pod \"maas-keycloak-0\" (UID: \"5547f3e9-d58a-488a-8588-3efb762004b8\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:33.013916 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.013807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5547f3e9-d58a-488a-8588-3efb762004b8-test-realms\") pod \"maas-keycloak-0\" (UID: \"5547f3e9-d58a-488a-8588-3efb762004b8\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:33.014496 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.014479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5547f3e9-d58a-488a-8588-3efb762004b8-test-realms\") pod \"maas-keycloak-0\" (UID: \"5547f3e9-d58a-488a-8588-3efb762004b8\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:33.022540 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.022470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt7vt\" (UniqueName: \"kubernetes.io/projected/5547f3e9-d58a-488a-8588-3efb762004b8-kube-api-access-pt7vt\") pod \"maas-keycloak-0\" (UID: \"5547f3e9-d58a-488a-8588-3efb762004b8\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:33.085775 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.085734 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:33.222905 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.222883 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:36:33.225210 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:36:33.225184 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5547f3e9_d58a_488a_8588_3efb762004b8.slice/crio-fa4787c27881309d47c1691c67c33ee713369ddbb6824ee0261397da54175a26 WatchSource:0}: Error finding container fa4787c27881309d47c1691c67c33ee713369ddbb6824ee0261397da54175a26: Status 404 returned error can't find the container with id fa4787c27881309d47c1691c67c33ee713369ddbb6824ee0261397da54175a26 Jun 11 21:36:33.226921 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.226902 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:36:33.737486 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.737452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5547f3e9-d58a-488a-8588-3efb762004b8","Type":"ContainerStarted","Data":"d81f1eb0adf8ad8e3027a180aa7d0b7da97d68e9723786952eea24893a42db1e"} Jun 11 21:36:33.737875 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.737506 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5547f3e9-d58a-488a-8588-3efb762004b8","Type":"ContainerStarted","Data":"fa4787c27881309d47c1691c67c33ee713369ddbb6824ee0261397da54175a26"} Jun 11 21:36:33.754830 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:33.754771 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.406727688 podStartE2EDuration="1.754750901s" totalImagesPullingTime="348.023213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:36:33.754609506 +0000 UTC m=+965.699146901" watchObservedRunningTime="2026-06-11 21:36:33.754750901 +0000 UTC m=+965.699288283" Jun 11 21:36:34.086774 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:34.086730 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:34.088426 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:34.088394 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:34.503267 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:34.503226 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5a4b59c-b8df-4ab3-ba7b-295b9ee87471" path="/var/lib/kubelet/pods/e5a4b59c-b8df-4ab3-ba7b-295b9ee87471/volumes" Jun 11 21:36:35.086867 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:35.086814 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:36.086220 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:36.086169 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:37.087266 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:37.087209 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:38.086264 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:38.086210 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:39.086675 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:39.086224 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:40.086420 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:40.086363 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:41.086925 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:41.086875 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:42.086877 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:42.086836 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:43.086672 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:43.086609 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:43.087172 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:43.086950 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:44.086518 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:44.086471 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:45.086397 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:45.086258 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:46.086263 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:46.086226 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 11 21:36:46.554203 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:46.554162 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:36:47.207492 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:47.207451 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 21:36:47.224694 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:47.224643 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5547f3e9-d58a-488a-8588-3efb762004b8" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:36:57.213423 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:36:57.213389 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 21:37:10.250299 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:10.250247 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:10.361379 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:10.361342 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:20.614146 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:20.614109 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:27.971674 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:27.971639 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:28.604309 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:28.604253 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:32.136702 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:32.136653 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:32.187372 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:32.187334 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:33.587240 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:33.587204 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:39.888905 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.888864 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x"] Jun 11 21:37:39.894462 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.894442 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:39.897832 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.897805 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 21:37:39.897832 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.897822 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 21:37:39.898027 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.897805 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 21:37:39.898027 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.897804 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hw8jb\"" Jun 11 21:37:39.903344 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.903313 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x"] Jun 11 21:37:39.920358 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.920327 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:37:39.955890 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.955855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:39.956043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.955899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2vsf\" (UniqueName: \"kubernetes.io/projected/7c21a4cd-f208-428e-b48d-f3e503192d54-kube-api-access-g2vsf\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:39.956043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.955946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c21a4cd-f208-428e-b48d-f3e503192d54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:39.956043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.955971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:39.956043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.955995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:39.956185 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:39.956071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.056548 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.056509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.056732 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.056566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.056732 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.056599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2vsf\" (UniqueName: \"kubernetes.io/projected/7c21a4cd-f208-428e-b48d-f3e503192d54-kube-api-access-g2vsf\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.056732 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.056628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c21a4cd-f208-428e-b48d-f3e503192d54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.056732 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.056653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.056732 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.056688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.056990 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.056966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.057043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.057009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.057086 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.057034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.059209 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.059176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c21a4cd-f208-428e-b48d-f3e503192d54-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.059468 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.059448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c21a4cd-f208-428e-b48d-f3e503192d54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.070049 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.070014 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2vsf\" (UniqueName: \"kubernetes.io/projected/7c21a4cd-f208-428e-b48d-f3e503192d54-kube-api-access-g2vsf\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x\" (UID: \"7c21a4cd-f208-428e-b48d-f3e503192d54\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.205745 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.205657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:37:40.346406 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:40.346379 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x"] Jun 11 21:37:40.348166 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:37:40.348134 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c21a4cd_f208_428e_b48d_f3e503192d54.slice/crio-609019fe6ac22a0aae52d98e41d98bcea9fc00f297bea684c89c36c7a6e60e43 WatchSource:0}: Error finding container 609019fe6ac22a0aae52d98e41d98bcea9fc00f297bea684c89c36c7a6e60e43: Status 404 returned error can't find the container with id 609019fe6ac22a0aae52d98e41d98bcea9fc00f297bea684c89c36c7a6e60e43 Jun 11 21:37:41.097826 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:41.097790 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" event={"ID":"7c21a4cd-f208-428e-b48d-f3e503192d54","Type":"ContainerStarted","Data":"609019fe6ac22a0aae52d98e41d98bcea9fc00f297bea684c89c36c7a6e60e43"} Jun 11 21:37:44.116622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:44.116581 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" event={"ID":"7c21a4cd-f208-428e-b48d-f3e503192d54","Type":"ContainerStarted","Data":"9b428ee627f7360ab5870fbdfceaee6dafbceace2a035c6cfb7ee6b82497c5e1"} Jun 11 21:37:58.523681 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:37:58.523636 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:38:08.785400 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.785364 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w"] Jun 11 21:38:08.789043 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.789020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:08.791440 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.791417 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 21:38:08.808056 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.808030 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w"] Jun 11 21:38:08.821445 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.821413 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:38:08.928997 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.928960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:08.928997 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.928997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7nm7\" (UniqueName: \"kubernetes.io/projected/2405a262-e95c-4462-84f1-799e5c143c98-kube-api-access-w7nm7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:08.929204 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.929018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:08.929204 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.929137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:08.929204 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.929190 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:08.929333 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:08.929246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2405a262-e95c-4462-84f1-799e5c143c98-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030048 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030226 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2405a262-e95c-4462-84f1-799e5c143c98-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030226 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030226 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7nm7\" (UniqueName: \"kubernetes.io/projected/2405a262-e95c-4462-84f1-799e5c143c98-kube-api-access-w7nm7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030226 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030226 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030622 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030595 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030696 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.030696 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.030635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.032578 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.032553 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2405a262-e95c-4462-84f1-799e5c143c98-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.032818 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.032798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2405a262-e95c-4462-84f1-799e5c143c98-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.038350 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.038304 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7nm7\" (UniqueName: \"kubernetes.io/projected/2405a262-e95c-4462-84f1-799e5c143c98-kube-api-access-w7nm7\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5c47w\" (UID: \"2405a262-e95c-4462-84f1-799e5c143c98\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.105628 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.105582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:09.244786 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:09.244760 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w"] Jun 11 21:38:09.247437 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:38:09.247407 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2405a262_e95c_4462_84f1_799e5c143c98.slice/crio-0f963b1a25a34c87151b6e37fa1d018fd8ddb26eb78a7b7f7dfb640708234f90 WatchSource:0}: Error finding container 0f963b1a25a34c87151b6e37fa1d018fd8ddb26eb78a7b7f7dfb640708234f90: Status 404 returned error can't find the container with id 0f963b1a25a34c87151b6e37fa1d018fd8ddb26eb78a7b7f7dfb640708234f90 Jun 11 21:38:10.238808 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:10.238769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" event={"ID":"2405a262-e95c-4462-84f1-799e5c143c98","Type":"ContainerStarted","Data":"3bb85c43a7f03e3cd96b59aab9eff30299088930d10225ee735da0ad3e9e0f88"} Jun 11 21:38:10.239209 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:10.238835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" event={"ID":"2405a262-e95c-4462-84f1-799e5c143c98","Type":"ContainerStarted","Data":"0f963b1a25a34c87151b6e37fa1d018fd8ddb26eb78a7b7f7dfb640708234f90"} Jun 11 21:38:11.245557 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:11.245514 2563 generic.go:356] "Generic (PLEG): container finished" podID="2405a262-e95c-4462-84f1-799e5c143c98" containerID="3bb85c43a7f03e3cd96b59aab9eff30299088930d10225ee735da0ad3e9e0f88" exitCode=0 Jun 11 21:38:11.246097 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:11.245586 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" event={"ID":"2405a262-e95c-4462-84f1-799e5c143c98","Type":"ContainerDied","Data":"3bb85c43a7f03e3cd96b59aab9eff30299088930d10225ee735da0ad3e9e0f88"} Jun 11 21:38:11.506825 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:11.506737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:38:13.265892 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:13.265851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" event={"ID":"2405a262-e95c-4462-84f1-799e5c143c98","Type":"ContainerStarted","Data":"4c4e6967ff1bc557518af26e1a49f58dd020affc312e7a41948eb15bb392c1f7"} Jun 11 21:38:13.287517 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:13.287460 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" podStartSLOduration=2.936958718 podStartE2EDuration="5.287445945s" totalImagesPullingTime="1.075527601s" totalInitContainerRuntime="1.274959626s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:38:13.285893134 +0000 UTC m=+1065.230430516" watchObservedRunningTime="2026-06-11 21:38:13.287445945 +0000 UTC m=+1065.231983325" Jun 11 21:38:19.105751 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:19.105657 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:19.105751 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:19.105733 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:19.118577 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:19.118549 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:38:19.306115 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:38:19.306088 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5c47w" Jun 11 21:39:19.090958 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:19.090923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:39:20.227892 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:20.227851 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:39:27.896125 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:27.896080 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:39:28.630671 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:28.630636 2563 generic.go:356] "Generic (PLEG): container finished" podID="7c21a4cd-f208-428e-b48d-f3e503192d54" containerID="9b428ee627f7360ab5870fbdfceaee6dafbceace2a035c6cfb7ee6b82497c5e1" exitCode=0 Jun 11 21:39:28.630840 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:28.630702 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" event={"ID":"7c21a4cd-f208-428e-b48d-f3e503192d54","Type":"ContainerDied","Data":"9b428ee627f7360ab5870fbdfceaee6dafbceace2a035c6cfb7ee6b82497c5e1"} Jun 11 21:39:29.638810 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:29.638777 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" event={"ID":"7c21a4cd-f208-428e-b48d-f3e503192d54","Type":"ContainerStarted","Data":"c542a0539ab14d0d2f09f9acc12cc36a8ae70c8c1b6cf3f26aab26ea44a6c149"} Jun 11 21:39:29.657835 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:29.657781 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" podStartSLOduration=2.427907536 podStartE2EDuration="1m50.657760344s" totalImagesPullingTime="3.142230513s" totalInitContainerRuntime="1m45.087622295s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:37:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:39:29.657098806 +0000 UTC m=+1141.601636189" watchObservedRunningTime="2026-06-11 21:39:29.657760344 +0000 UTC m=+1141.602297738" Jun 11 21:39:30.206004 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:30.205965 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:39:30.206190 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:30.206042 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:39:30.218732 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:30.218705 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:39:30.655276 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:39:30.655250 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x" Jun 11 21:40:28.534890 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:28.534858 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:40:28.535457 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:28.535439 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:40:46.012434 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:46.012390 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:40:47.668639 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.668577 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:40:47.794952 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.794912 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f5bf9f677-gxhw9"] Jun 11 21:40:47.798680 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.798658 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:47.801969 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.801935 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d7k2k\"" Jun 11 21:40:47.802078 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.801939 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 21:40:47.802078 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.802022 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 21:40:47.807264 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.807240 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5bf9f677-gxhw9"] Jun 11 21:40:47.921484 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.921400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e2b80-073c-4384-9e10-e3cbb9a065d1-webhook-cert\") pod \"maas-controller-f5bf9f677-gxhw9\" (UID: \"9f8e2b80-073c-4384-9e10-e3cbb9a065d1\") " pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:47.921630 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:47.921516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtxs\" (UniqueName: \"kubernetes.io/projected/9f8e2b80-073c-4384-9e10-e3cbb9a065d1-kube-api-access-2vtxs\") pod \"maas-controller-f5bf9f677-gxhw9\" (UID: \"9f8e2b80-073c-4384-9e10-e3cbb9a065d1\") " pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:48.022298 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:48.022251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e2b80-073c-4384-9e10-e3cbb9a065d1-webhook-cert\") pod \"maas-controller-f5bf9f677-gxhw9\" (UID: \"9f8e2b80-073c-4384-9e10-e3cbb9a065d1\") " pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:48.022476 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:48.022349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtxs\" (UniqueName: \"kubernetes.io/projected/9f8e2b80-073c-4384-9e10-e3cbb9a065d1-kube-api-access-2vtxs\") pod \"maas-controller-f5bf9f677-gxhw9\" (UID: \"9f8e2b80-073c-4384-9e10-e3cbb9a065d1\") " pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:48.024819 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:48.024795 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f8e2b80-073c-4384-9e10-e3cbb9a065d1-webhook-cert\") pod \"maas-controller-f5bf9f677-gxhw9\" (UID: \"9f8e2b80-073c-4384-9e10-e3cbb9a065d1\") " pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:48.030696 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:48.030675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtxs\" (UniqueName: \"kubernetes.io/projected/9f8e2b80-073c-4384-9e10-e3cbb9a065d1-kube-api-access-2vtxs\") pod \"maas-controller-f5bf9f677-gxhw9\" (UID: \"9f8e2b80-073c-4384-9e10-e3cbb9a065d1\") " pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:48.110074 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:48.110045 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:48.246734 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:48.246704 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5bf9f677-gxhw9"] Jun 11 21:40:48.248500 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:40:48.248468 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8e2b80_073c_4384_9e10_e3cbb9a065d1.slice/crio-b6ed017da6adcdcbdbe931dc1aaed7458c4cea5286e7bddc704f2300b37e9689 WatchSource:0}: Error finding container b6ed017da6adcdcbdbe931dc1aaed7458c4cea5286e7bddc704f2300b37e9689: Status 404 returned error can't find the container with id b6ed017da6adcdcbdbe931dc1aaed7458c4cea5286e7bddc704f2300b37e9689 Jun 11 21:40:49.028113 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:49.028071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5bf9f677-gxhw9" event={"ID":"9f8e2b80-073c-4384-9e10-e3cbb9a065d1","Type":"ContainerStarted","Data":"f500b797331452bab9b0275908aae5363ec1811582a70814be843b82e4bb9962"} Jun 11 21:40:49.028560 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:49.028137 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5bf9f677-gxhw9" event={"ID":"9f8e2b80-073c-4384-9e10-e3cbb9a065d1","Type":"ContainerStarted","Data":"b6ed017da6adcdcbdbe931dc1aaed7458c4cea5286e7bddc704f2300b37e9689"} Jun 11 21:40:49.028560 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:49.028195 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:40:49.045316 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:40:49.045243 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f5bf9f677-gxhw9" podStartSLOduration=1.59488147 podStartE2EDuration="2.045220866s" totalImagesPullingTime="450.339396ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:40:49.042914551 +0000 UTC m=+1220.987451933" watchObservedRunningTime="2026-06-11 21:40:49.045220866 +0000 UTC m=+1220.989758250" Jun 11 21:41:00.038852 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:41:00.038817 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f5bf9f677-gxhw9" Jun 11 21:41:27.500212 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:41:27.500121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:41:27.602451 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:41:27.602415 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:41:35.975624 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:41:35.975589 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:41:41.539799 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:41:41.539752 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:41:41.589895 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:41:41.589857 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:13.739553 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:13.739515 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:13.835888 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:13.835846 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:37.680951 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:37.680906 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:43.520700 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:43.520662 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:43.570943 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:43.570898 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:43.649634 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:43.649597 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:43.746861 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:43.746814 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:43.880558 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:43.880472 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:42:43.991179 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:42:43.991141 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:00.646353 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:00.646248 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:00.736744 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:00.736703 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:00.836584 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:00.836549 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:07.266069 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:07.266028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:07.366351 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:07.366268 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:14.737653 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:14.737614 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:14.838162 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:14.838120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:14.937814 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:14.937773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:15.037822 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:15.037732 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:16.712924 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:16.712887 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:16.813056 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:16.813017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:31.408529 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:31.408489 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:31.511456 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:31.511404 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:31.617758 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:31.617698 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:34.955727 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:34.955684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:35.056660 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:35.056626 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:37.404129 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:37.404091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:37.456412 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:37.456377 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:53.605754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:53.605712 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:53.706258 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:53.706220 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:53.814978 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:53.814941 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:59.441615 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:59.441567 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:59.542036 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:59.541996 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:59.644999 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:59.644959 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:59.778579 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:43:59.778544 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:44:05.349135 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:44:05.349087 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:44:05.406474 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:44:05.406442 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:45:28.569786 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:45:28.569756 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:45:28.570330 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:45:28.569790 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:45:46.679411 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:45:46.679331 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:25.428974 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:46:25.428933 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:28.604420 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:28.604393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:50:28.605421 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:28.605402 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:50:50.819921 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:50.819882 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt"] Jun 11 21:50:50.820450 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:50.820120 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" podUID="133db14a-862d-4cbe-b6e4-c8db8143b72d" containerName="manager" containerID="cri-o://efb855e8860a10ffece1799ae96d1cafd80ee081ded6016b813fc3c57bb9a9b5" gracePeriod=10 Jun 11 21:50:50.966591 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:50.966563 2563 generic.go:356] "Generic (PLEG): container finished" podID="133db14a-862d-4cbe-b6e4-c8db8143b72d" containerID="efb855e8860a10ffece1799ae96d1cafd80ee081ded6016b813fc3c57bb9a9b5" exitCode=0 Jun 11 21:50:50.966742 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:50.966637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" event={"ID":"133db14a-862d-4cbe-b6e4-c8db8143b72d","Type":"ContainerDied","Data":"efb855e8860a10ffece1799ae96d1cafd80ee081ded6016b813fc3c57bb9a9b5"} Jun 11 21:50:51.081957 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.081888 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:50:51.095632 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.095605 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8dxs\" (UniqueName: \"kubernetes.io/projected/133db14a-862d-4cbe-b6e4-c8db8143b72d-kube-api-access-h8dxs\") pod \"133db14a-862d-4cbe-b6e4-c8db8143b72d\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " Jun 11 21:50:51.095754 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.095649 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/133db14a-862d-4cbe-b6e4-c8db8143b72d-extensions-socket-volume\") pod \"133db14a-862d-4cbe-b6e4-c8db8143b72d\" (UID: \"133db14a-862d-4cbe-b6e4-c8db8143b72d\") " Jun 11 21:50:51.096079 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.096053 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133db14a-862d-4cbe-b6e4-c8db8143b72d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "133db14a-862d-4cbe-b6e4-c8db8143b72d" (UID: "133db14a-862d-4cbe-b6e4-c8db8143b72d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:50:51.097721 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.097693 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133db14a-862d-4cbe-b6e4-c8db8143b72d-kube-api-access-h8dxs" (OuterVolumeSpecName: "kube-api-access-h8dxs") pod "133db14a-862d-4cbe-b6e4-c8db8143b72d" (UID: "133db14a-862d-4cbe-b6e4-c8db8143b72d"). InnerVolumeSpecName "kube-api-access-h8dxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:50:51.196599 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.196573 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8dxs\" (UniqueName: \"kubernetes.io/projected/133db14a-862d-4cbe-b6e4-c8db8143b72d-kube-api-access-h8dxs\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:50:51.196599 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.196598 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/133db14a-862d-4cbe-b6e4-c8db8143b72d-extensions-socket-volume\") on node \"ip-10-0-138-17.ec2.internal\" DevicePath \"\"" Jun 11 21:50:51.972144 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.972111 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" Jun 11 21:50:51.972144 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.972127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt" event={"ID":"133db14a-862d-4cbe-b6e4-c8db8143b72d","Type":"ContainerDied","Data":"765241cec321bd1c4c0c0d9488aaeee9bae53d8a490d9111a2345383eef2bdea"} Jun 11 21:50:51.972646 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.972188 2563 scope.go:117] "RemoveContainer" containerID="efb855e8860a10ffece1799ae96d1cafd80ee081ded6016b813fc3c57bb9a9b5" Jun 11 21:50:51.994061 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.994034 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt"] Jun 11 21:50:51.998850 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:51.998829 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zpmt"] Jun 11 21:50:52.500189 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:50:52.500158 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133db14a-862d-4cbe-b6e4-c8db8143b72d" path="/var/lib/kubelet/pods/133db14a-862d-4cbe-b6e4-c8db8143b72d/volumes" Jun 11 21:51:23.841909 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:23.841875 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:24.914317 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:24.914259 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:57.058189 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.058104 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg"] Jun 11 21:51:57.058760 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.058707 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133db14a-862d-4cbe-b6e4-c8db8143b72d" containerName="manager" Jun 11 21:51:57.058760 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.058728 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="133db14a-862d-4cbe-b6e4-c8db8143b72d" containerName="manager" Jun 11 21:51:57.058881 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.058850 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="133db14a-862d-4cbe-b6e4-c8db8143b72d" containerName="manager" Jun 11 21:51:57.061764 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.061744 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.067615 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.067587 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nn7cz\"" Jun 11 21:51:57.075170 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.075145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg"] Jun 11 21:51:57.099274 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.099245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79f576c3-5d22-4cf9-9693-bcaa26025f1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wklhg\" (UID: \"79f576c3-5d22-4cf9-9693-bcaa26025f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.099420 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.099375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk4sh\" (UniqueName: \"kubernetes.io/projected/79f576c3-5d22-4cf9-9693-bcaa26025f1e-kube-api-access-qk4sh\") pod \"kuadrant-operator-controller-manager-86878c769f-wklhg\" (UID: \"79f576c3-5d22-4cf9-9693-bcaa26025f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.200072 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.200030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79f576c3-5d22-4cf9-9693-bcaa26025f1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wklhg\" (UID: \"79f576c3-5d22-4cf9-9693-bcaa26025f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.200277 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.200142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk4sh\" (UniqueName: \"kubernetes.io/projected/79f576c3-5d22-4cf9-9693-bcaa26025f1e-kube-api-access-qk4sh\") pod \"kuadrant-operator-controller-manager-86878c769f-wklhg\" (UID: \"79f576c3-5d22-4cf9-9693-bcaa26025f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.200463 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.200440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79f576c3-5d22-4cf9-9693-bcaa26025f1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wklhg\" (UID: \"79f576c3-5d22-4cf9-9693-bcaa26025f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.212182 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.212156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk4sh\" (UniqueName: \"kubernetes.io/projected/79f576c3-5d22-4cf9-9693-bcaa26025f1e-kube-api-access-qk4sh\") pod \"kuadrant-operator-controller-manager-86878c769f-wklhg\" (UID: \"79f576c3-5d22-4cf9-9693-bcaa26025f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.372437 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.372355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:57.518954 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:57.518928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg"] Jun 11 21:51:57.520925 ip-10-0-138-17 kubenswrapper[2563]: W0611 21:51:57.520899 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f576c3_5d22_4cf9_9693_bcaa26025f1e.slice/crio-2f058875e1389a638c1990be4cc68f171648a4005f7246105ee8dd95db2a11d6 WatchSource:0}: Error finding container 2f058875e1389a638c1990be4cc68f171648a4005f7246105ee8dd95db2a11d6: Status 404 returned error can't find the container with id 2f058875e1389a638c1990be4cc68f171648a4005f7246105ee8dd95db2a11d6 Jun 11 21:51:58.286101 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:58.286067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" event={"ID":"79f576c3-5d22-4cf9-9693-bcaa26025f1e","Type":"ContainerStarted","Data":"7d97154c39fc40649cebb247b89fc18b8bcfd046d65887a2c1e49176c9b99fa5"} Jun 11 21:51:58.286505 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:58.286120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" event={"ID":"79f576c3-5d22-4cf9-9693-bcaa26025f1e","Type":"ContainerStarted","Data":"2f058875e1389a638c1990be4cc68f171648a4005f7246105ee8dd95db2a11d6"} Jun 11 21:51:58.286505 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:58.286149 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:51:58.309451 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:51:58.309402 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" podStartSLOduration=1.3093858649999999 podStartE2EDuration="1.309385865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:58.306460988 +0000 UTC m=+1890.250998378" watchObservedRunningTime="2026-06-11 21:51:58.309385865 +0000 UTC m=+1890.253923246" Jun 11 21:52:09.292584 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:52:09.292549 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wklhg" Jun 11 21:52:39.661229 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:52:39.661185 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:39.714500 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:52:39.714462 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:41.923148 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:52:41.923109 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:28.635621 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:55:28.635593 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:55:28.637997 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:55:28.637973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 21:56:11.058770 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:56:11.058730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:57:57.054684 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:57:57.054584 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:57:58.146627 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:57:58.146589 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 21:58:11.538591 ip-10-0-138-17 kubenswrapper[2563]: I0611 21:58:11.538542 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:00:28.669482 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:00:28.669449 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 22:00:28.671907 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:00:28.671880 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 22:00:37.810792 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:00:37.810754 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:00:41.068494 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:00:41.068454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:05.318026 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:05.317981 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:18.406972 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:18.406933 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:20.076586 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:20.076541 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:20.180421 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:20.180387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:20.279733 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:20.279694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:23.762974 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:23.762921 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:26.321233 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:26.321175 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:26.498741 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:26.498703 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:26.606955 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:26.604996 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:28.301489 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:28.301454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:32.622782 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:32.622741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:32.827834 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:32.827803 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:32.916906 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:32.916814 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:33.018699 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:33.018656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:33.164249 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:33.164205 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:36.200133 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:36.200091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:39.064158 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:39.064121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:40.243250 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:40.243207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:40.344468 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:40.344421 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:41.922925 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:41.922887 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:46.230813 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:46.230778 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:46.331096 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:46.331055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:01:57.487215 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:57.487181 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5bf8984b-gb848_99e53be6-809c-4bef-b845-24f5c582e559/maas-api/0.log" Jun 11 22:01:57.826749 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:57.826661 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f5bf9f677-gxhw9_9f8e2b80-073c-4384-9e10-e3cbb9a065d1/manager/0.log" Jun 11 22:01:58.423646 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:58.423616 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-svkl9_fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a/manager/0.log" Jun 11 22:01:58.430375 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:01:58.430355 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-svkl9_fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a/copy-manifests/0.log" Jun 11 22:02:00.427090 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:00.427053 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wklhg_79f576c3-5d22-4cf9-9693-bcaa26025f1e/manager/0.log" Jun 11 22:02:00.667069 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:00.667034 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hzxnh_393cd342-d7fb-47f2-a84b-96f1ff618087/manager/0.log" Jun 11 22:02:01.353669 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:01.353626 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb5d69dd-jptzz_fcb5a617-adfa-4cfb-bbf5-a3a596439bd3/kube-auth-proxy/0.log" Jun 11 22:02:01.596878 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:01.596843 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zcpz2_05545275-d313-40f8-abd9-ad07f239f35c/payload-pre-processing/0.log" Jun 11 22:02:02.411913 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:02.411875 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x_7c21a4cd-f208-428e-b48d-f3e503192d54/storage-initializer/0.log" Jun 11 22:02:02.419866 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:02.419839 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-k4l2x_7c21a4cd-f208-428e-b48d-f3e503192d54/main/0.log" Jun 11 22:02:02.651525 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:02.651494 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5c47w_2405a262-e95c-4462-84f1-799e5c143c98/storage-initializer/0.log" Jun 11 22:02:02.658504 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:02.658480 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5c47w_2405a262-e95c-4462-84f1-799e5c143c98/main/0.log" Jun 11 22:02:06.891321 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:06.891268 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:02:06.991580 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:06.991544 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" limit=1024 Jun 11 22:02:09.969729 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:09.969683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2ndxt_ca6dd972-369c-4017-9d02-85b937fdaa45/global-pull-secret-syncer/0.log" Jun 11 22:02:10.102738 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:10.102707 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mpg6h_efe493e9-bfb7-4cc8-bf80-51daba89e0c4/konnectivity-agent/0.log" Jun 11 22:02:10.225718 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:10.225636 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-17.ec2.internal_84b106941e4bd3acb99330a3abc18a7d/haproxy/0.log" Jun 11 22:02:15.355211 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:15.355177 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wklhg_79f576c3-5d22-4cf9-9693-bcaa26025f1e/manager/0.log" Jun 11 22:02:15.554820 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:15.554784 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hzxnh_393cd342-d7fb-47f2-a84b-96f1ff618087/manager/0.log" Jun 11 22:02:17.169662 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.169633 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c62617-c307-4080-b4f9-7ee8a3eb3d0b/alertmanager/0.log" Jun 11 22:02:17.190992 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.190965 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c62617-c307-4080-b4f9-7ee8a3eb3d0b/config-reloader/0.log" Jun 11 22:02:17.212089 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.212022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c62617-c307-4080-b4f9-7ee8a3eb3d0b/kube-rbac-proxy-web/0.log" Jun 11 22:02:17.237570 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.237540 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c62617-c307-4080-b4f9-7ee8a3eb3d0b/kube-rbac-proxy/0.log" Jun 11 22:02:17.259621 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.259594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c62617-c307-4080-b4f9-7ee8a3eb3d0b/kube-rbac-proxy-metric/0.log" Jun 11 22:02:17.281422 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.281347 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c62617-c307-4080-b4f9-7ee8a3eb3d0b/prom-label-proxy/0.log" Jun 11 22:02:17.302195 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.302164 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_32c62617-c307-4080-b4f9-7ee8a3eb3d0b/init-config-reloader/0.log" Jun 11 22:02:17.361034 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.360994 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-v2pm2_d0ef2266-ef72-4b79-9299-65aa62a1c548/cluster-monitoring-operator/0.log" Jun 11 22:02:17.454907 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.454866 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7df7d5c7cd-f9qmr_d03359c3-0049-4acd-93c5-8fc560887498/metrics-server/0.log" Jun 11 22:02:17.597205 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.597113 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg77h_a6f7d374-c34e-482e-a663-fcce8f1c7217/node-exporter/0.log" Jun 11 22:02:17.615659 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.615629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg77h_a6f7d374-c34e-482e-a663-fcce8f1c7217/kube-rbac-proxy/0.log" Jun 11 22:02:17.635387 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.635363 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg77h_a6f7d374-c34e-482e-a663-fcce8f1c7217/init-textfile/0.log" Jun 11 22:02:17.825828 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.825779 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3f12a0d-2770-4e82-879c-3cbac57651dc/prometheus/0.log" Jun 11 22:02:17.845542 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.845514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3f12a0d-2770-4e82-879c-3cbac57651dc/config-reloader/0.log" Jun 11 22:02:17.867318 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.867204 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3f12a0d-2770-4e82-879c-3cbac57651dc/thanos-sidecar/0.log" Jun 11 22:02:17.887711 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.887682 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3f12a0d-2770-4e82-879c-3cbac57651dc/kube-rbac-proxy-web/0.log" Jun 11 22:02:17.907684 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.907654 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3f12a0d-2770-4e82-879c-3cbac57651dc/kube-rbac-proxy/0.log" Jun 11 22:02:17.927577 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.927549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3f12a0d-2770-4e82-879c-3cbac57651dc/kube-rbac-proxy-thanos/0.log" Jun 11 22:02:17.950600 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.950575 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f3f12a0d-2770-4e82-879c-3cbac57651dc/init-config-reloader/0.log" Jun 11 22:02:17.992979 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:17.992953 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-45tgd_329fad02-4580-46c7-be29-9c12d06e491a/prometheus-operator/0.log" Jun 11 22:02:18.008937 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:18.008913 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-45tgd_329fad02-4580-46c7-be29-9c12d06e491a/kube-rbac-proxy/0.log" Jun 11 22:02:18.076162 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:18.076137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798df696b-dhdmx_0a65437e-f929-42ae-b677-9a49fcb13818/telemeter-client/0.log" Jun 11 22:02:18.114507 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:18.114480 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798df696b-dhdmx_0a65437e-f929-42ae-b677-9a49fcb13818/reload/0.log" Jun 11 22:02:18.138564 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:18.138485 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7798df696b-dhdmx_0a65437e-f929-42ae-b677-9a49fcb13818/kube-rbac-proxy/0.log" Jun 11 22:02:20.336810 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:20.336780 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/1.log" Jun 11 22:02:20.350782 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:20.350742 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-kgtvc_3dc7c258-a851-4895-bd3e-f15e41c9c45c/console-operator/2.log" Jun 11 22:02:20.980109 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:20.980072 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-8qftt_78daced3-a5ee-414b-9c56-6e62644fc24a/download-server/0.log" Jun 11 22:02:21.702353 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.702312 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx"] Jun 11 22:02:21.706366 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.706342 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.709137 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.709111 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfrc4\"/\"openshift-service-ca.crt\"" Jun 11 22:02:21.709248 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.709158 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfrc4\"/\"kube-root-ca.crt\"" Jun 11 22:02:21.710207 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.710177 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lfrc4\"/\"default-dockercfg-vbjnd\"" Jun 11 22:02:21.713870 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.713786 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx"] Jun 11 22:02:21.805696 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.805660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdtb\" (UniqueName: \"kubernetes.io/projected/67ff481d-95b2-469a-81cf-7c7aa0601c26-kube-api-access-dtdtb\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.805897 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.805760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-lib-modules\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.805897 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.805821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-proc\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.805897 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.805850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-sys\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.806040 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.805914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-podres\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907428 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-lib-modules\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907631 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-proc\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907631 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-sys\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907631 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-podres\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907631 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdtb\" (UniqueName: \"kubernetes.io/projected/67ff481d-95b2-469a-81cf-7c7aa0601c26-kube-api-access-dtdtb\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907631 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907581 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-lib-modules\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907631 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907595 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-sys\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907631 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-proc\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.907930 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.907675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/67ff481d-95b2-469a-81cf-7c7aa0601c26-podres\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:21.915892 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:21.915873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdtb\" (UniqueName: \"kubernetes.io/projected/67ff481d-95b2-469a-81cf-7c7aa0601c26-kube-api-access-dtdtb\") pod \"perf-node-gather-daemonset-fq7tx\" (UID: \"67ff481d-95b2-469a-81cf-7c7aa0601c26\") " pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:22.018032 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.017994 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:22.151728 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.151702 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx"] Jun 11 22:02:22.153548 ip-10-0-138-17 kubenswrapper[2563]: W0611 22:02:22.153504 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67ff481d_95b2_469a_81cf_7c7aa0601c26.slice/crio-64749cb46c5d002f49235e50f2c5eae349393a733c75e34ca22fe6e8f0e79993 WatchSource:0}: Error finding container 64749cb46c5d002f49235e50f2c5eae349393a733c75e34ca22fe6e8f0e79993: Status 404 returned error can't find the container with id 64749cb46c5d002f49235e50f2c5eae349393a733c75e34ca22fe6e8f0e79993 Jun 11 22:02:22.354143 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.354043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" event={"ID":"67ff481d-95b2-469a-81cf-7c7aa0601c26","Type":"ContainerStarted","Data":"a7bf5123de0aa89b709219c8033371ff12d779d11d51a05341786ad77811db8a"} Jun 11 22:02:22.354143 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.354125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" event={"ID":"67ff481d-95b2-469a-81cf-7c7aa0601c26","Type":"ContainerStarted","Data":"64749cb46c5d002f49235e50f2c5eae349393a733c75e34ca22fe6e8f0e79993"} Jun 11 22:02:22.354368 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.354176 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:22.371005 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.370946 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" podStartSLOduration=1.370927775 podStartE2EDuration="1.370927775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 22:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 22:02:22.368934174 +0000 UTC m=+2514.313471572" watchObservedRunningTime="2026-06-11 22:02:22.370927775 +0000 UTC m=+2514.315465155" Jun 11 22:02:22.948406 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.948371 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vphm_e6f00c64-ef93-4f21-8468-93f4ee6cc61f/dns/0.log" Jun 11 22:02:22.968005 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:22.967973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vphm_e6f00c64-ef93-4f21-8468-93f4ee6cc61f/kube-rbac-proxy/0.log" Jun 11 22:02:23.077599 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:23.077567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zkbvv_c03ec144-49ce-48a3-b6ab-2644e556a7e3/dns-node-resolver/0.log" Jun 11 22:02:23.579344 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:23.579310 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67995499b6-lvdms_130b62b1-9220-4d93-9349-85d0cc9ac8c4/registry/0.log" Jun 11 22:02:23.596292 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:23.596241 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67995499b6-lvdms_130b62b1-9220-4d93-9349-85d0cc9ac8c4/registry/1.log" Jun 11 22:02:23.663870 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:23.663809 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6q2b_67719a28-cefc-469d-8582-fde072f45b8c/node-ca/0.log" Jun 11 22:02:24.764866 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:24.764830 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb5d69dd-jptzz_fcb5a617-adfa-4cfb-bbf5-a3a596439bd3/kube-auth-proxy/0.log" Jun 11 22:02:24.901595 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:24.901553 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zcpz2_05545275-d313-40f8-abd9-ad07f239f35c/payload-pre-processing/0.log" Jun 11 22:02:25.660315 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:25.660269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6zklz_70eb1d10-ae30-413a-aa9b-217e336182a7/serve-healthcheck-canary/0.log" Jun 11 22:02:26.372150 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:26.372118 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2w4f_f5369e28-ac8b-448d-8451-c10c33268f3b/kube-rbac-proxy/0.log" Jun 11 22:02:26.392491 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:26.392459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2w4f_f5369e28-ac8b-448d-8451-c10c33268f3b/exporter/0.log" Jun 11 22:02:26.413313 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:26.413262 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t2w4f_f5369e28-ac8b-448d-8451-c10c33268f3b/extractor/0.log" Jun 11 22:02:28.369853 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:28.369821 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lfrc4/perf-node-gather-daemonset-fq7tx" Jun 11 22:02:28.811876 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:28.811839 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5bf8984b-gb848_99e53be6-809c-4bef-b845-24f5c582e559/maas-api/0.log" Jun 11 22:02:28.972481 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:28.972444 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f5bf9f677-gxhw9_9f8e2b80-073c-4384-9e10-e3cbb9a065d1/manager/0.log" Jun 11 22:02:29.313098 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:29.313068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-svkl9_fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a/manager/0.log" Jun 11 22:02:29.331708 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:29.331679 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75f49467f8-svkl9_fe96fa0f-ef1c-4b43-8370-4f2c0c86b24a/copy-manifests/0.log" Jun 11 22:02:31.064257 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:31.064221 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56b9fd76f8-lhjlz_b785c441-58c2-442d-9ba6-4507aca7a946/manager/0.log" Jun 11 22:02:35.031341 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:35.031306 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb5d69dd-jptzz_fcb5a617-adfa-4cfb-bbf5-a3a596439bd3/kube-auth-proxy/0.log" Jun 11 22:02:35.155440 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:35.155411 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zcpz2_05545275-d313-40f8-abd9-ad07f239f35c/payload-pre-processing/0.log" Jun 11 22:02:36.420169 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:36.420123 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-fplqz_dd8e9ad4-02dc-4997-94d8-f58b5a532c29/migrator/0.log" Jun 11 22:02:36.444053 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:36.444025 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-fplqz_dd8e9ad4-02dc-4997-94d8-f58b5a532c29/graceful-termination/0.log" Jun 11 22:02:36.478646 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:36.478614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb5d69dd-jptzz_fcb5a617-adfa-4cfb-bbf5-a3a596439bd3/kube-auth-proxy/0.log" Jun 11 22:02:36.594573 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:36.594538 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zcpz2_05545275-d313-40f8-abd9-ad07f239f35c/payload-pre-processing/0.log" Jun 11 22:02:38.148458 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.148426 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-292vv_05c02e3d-d937-4ff3-9010-99701fc57d85/kube-multus-additional-cni-plugins/0.log" Jun 11 22:02:38.170131 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.170104 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-292vv_05c02e3d-d937-4ff3-9010-99701fc57d85/egress-router-binary-copy/0.log" Jun 11 22:02:38.189902 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.189876 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-292vv_05c02e3d-d937-4ff3-9010-99701fc57d85/cni-plugins/0.log" Jun 11 22:02:38.210034 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.210010 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-292vv_05c02e3d-d937-4ff3-9010-99701fc57d85/bond-cni-plugin/0.log" Jun 11 22:02:38.229021 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.228988 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-292vv_05c02e3d-d937-4ff3-9010-99701fc57d85/routeoverride-cni/0.log" Jun 11 22:02:38.248729 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.248698 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-292vv_05c02e3d-d937-4ff3-9010-99701fc57d85/whereabouts-cni-bincopy/0.log" Jun 11 22:02:38.268327 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.268208 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-292vv_05c02e3d-d937-4ff3-9010-99701fc57d85/whereabouts-cni/0.log" Jun 11 22:02:38.475648 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.475622 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb5d69dd-jptzz_fcb5a617-adfa-4cfb-bbf5-a3a596439bd3/kube-auth-proxy/0.log" Jun 11 22:02:38.621545 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.621455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-zcpz2_05545275-d313-40f8-abd9-ad07f239f35c/payload-pre-processing/0.log" Jun 11 22:02:38.805579 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.805548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hsh8x_6d7a371e-2869-4317-8eb4-fa094127573b/kube-multus/0.log" Jun 11 22:02:38.974649 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.974618 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pzdps_bd92ef1c-51b4-4a53-bcb4-3e1901dbe949/network-metrics-daemon/0.log" Jun 11 22:02:38.994008 ip-10-0-138-17 kubenswrapper[2563]: I0611 22:02:38.993981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pzdps_bd92ef1c-51b4-4a53-bcb4-3e1901dbe949/kube-rbac-proxy/0.log"