Jun 13 02:00:54.166300 ip-10-0-132-107 systemd[1]: Starting Kubernetes Kubelet... Jun 13 02:00:54.549454 ip-10-0-132-107 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:54.549454 ip-10-0-132-107 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 02:00:54.549454 ip-10-0-132-107 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:54.549454 ip-10-0-132-107 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 02:00:54.549454 ip-10-0-132-107 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 02:00:54.550234 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.549508 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 02:00:54.553889 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553872 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:54.553889 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553887 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:54.553889 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553890 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:54.553889 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553893 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553897 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553900 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553903 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553905 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553913 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553916 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553918 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553921 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553924 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553926 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553929 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553931 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553934 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553937 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553939 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553942 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553944 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553947 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553949 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:54.554045 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553952 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553954 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553957 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553961 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553965 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553981 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553984 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553987 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553990 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553992 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553995 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.553998 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554001 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554003 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554007 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554009 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554012 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554015 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554018 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:54.554538 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554020 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554023 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554026 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554028 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554032 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554035 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554037 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554040 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554042 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554045 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554048 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554051 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554053 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554056 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554059 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554063 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554067 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554070 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554073 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:54.555025 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554076 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554079 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554081 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554084 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554087 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554090 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554093 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554097 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554101 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554105 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554108 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554111 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554114 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554117 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554120 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554123 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554125 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554128 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554130 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554133 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:54.555493 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554136 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554138 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554141 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554143 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554146 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554148 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554151 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554153 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554156 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554158 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554161 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554163 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554166 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554168 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554171 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554173 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554175 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554178 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554885 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554891 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:54.556107 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554896 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554900 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554903 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554905 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554910 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554915 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554919 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554921 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554924 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554927 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554929 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554932 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554935 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554937 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554940 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554942 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554945 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554948 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554950 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:54.556640 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554953 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554956 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554958 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554961 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554964 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554966 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554985 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554988 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554990 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554993 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554996 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.554998 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555001 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555004 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555007 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555010 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555012 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555015 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555018 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555021 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:54.557490 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555024 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555027 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555029 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555032 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555035 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555038 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555041 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555043 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555046 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555048 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555051 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555055 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555058 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555061 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555064 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555067 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555071 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555074 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555078 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:54.558259 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555081 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555084 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555087 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555090 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555093 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555096 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555099 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555103 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555106 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555109 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555111 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555114 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555116 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555119 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555122 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555125 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555127 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555130 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555132 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555135 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:54.558777 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555137 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555140 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555142 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555145 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555148 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555150 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555153 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555155 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555157 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555160 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555163 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555165 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555168 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555171 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555174 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555176 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555179 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555182 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555184 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555519 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:54.559291 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555524 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555526 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555529 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555532 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555535 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555538 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555541 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555543 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555546 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555549 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555551 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555554 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555557 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555561 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555564 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555566 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555569 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555571 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555574 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555576 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:54.559786 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555579 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555582 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555584 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555587 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555589 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555593 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555595 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555598 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555600 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555605 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555608 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555610 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555613 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555615 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555618 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555620 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555623 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555625 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555628 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555631 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:54.560321 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555634 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555636 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555639 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555642 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555645 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555647 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555650 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555652 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555654 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555658 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555661 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555664 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555667 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555670 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555673 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555676 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555679 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555681 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555684 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:54.560806 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555687 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555689 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555694 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555697 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555701 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555703 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555707 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555710 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555713 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555715 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555718 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555720 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555723 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555726 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555729 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555731 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555733 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555736 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555738 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555741 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:54.561286 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555743 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555746 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555748 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555751 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555753 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555756 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555758 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555761 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555763 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555766 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555769 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555772 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555774 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555777 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555780 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555783 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555785 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555788 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.555790 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555860 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555867 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 02:00:54.561811 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555874 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555878 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555891 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555896 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555902 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555909 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555914 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555917 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555921 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555924 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555927 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555931 2579 flags.go:64] FLAG: --cgroup-root="" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555934 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555937 2579 flags.go:64] FLAG: --client-ca-file="" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555939 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555942 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555946 2579 flags.go:64] FLAG: --cluster-domain="" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555949 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555952 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555956 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555959 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555963 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555966 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 02:00:54.562336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555983 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555987 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555992 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555995 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.555998 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556001 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556003 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556007 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556010 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556013 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556016 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556019 2579 flags.go:64] FLAG: --enable-server="true" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556022 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556026 2579 flags.go:64] FLAG: --event-burst="100" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556030 2579 flags.go:64] FLAG: --event-qps="50" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556037 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556040 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556044 2579 flags.go:64] FLAG: --eviction-hard="" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556052 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556055 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556057 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556060 2579 flags.go:64] FLAG: --eviction-soft="" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556063 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556066 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556069 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 02:00:54.562891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556072 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556075 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556078 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556080 2579 flags.go:64] FLAG: --feature-gates="" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556084 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556090 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556094 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556097 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556100 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556105 2579 flags.go:64] FLAG: --help="false" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556109 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556112 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556115 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556118 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556122 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556126 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556129 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556131 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556134 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556137 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556140 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556144 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556147 2579 flags.go:64] FLAG: --kube-reserved="" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556150 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 02:00:54.563526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556153 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556156 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556159 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556162 2579 flags.go:64] FLAG: --lock-file="" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556165 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556168 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556171 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556176 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556179 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556182 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556185 2579 flags.go:64] FLAG: --logging-format="text" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556188 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556191 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556195 2579 flags.go:64] FLAG: --manifest-url="" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556198 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556203 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556206 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556210 2579 flags.go:64] FLAG: --max-pods="110" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556214 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556217 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556220 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556223 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556226 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556229 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556232 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 02:00:54.564142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556239 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556242 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556245 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556248 2579 flags.go:64] FLAG: --pod-cidr="" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556251 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556256 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556259 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556263 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556266 2579 flags.go:64] FLAG: --port="10250" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556269 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556272 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028f550c93c40cb63" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556275 2579 flags.go:64] FLAG: --qos-reserved="" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556278 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556281 2579 flags.go:64] FLAG: --register-node="true" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556284 2579 flags.go:64] FLAG: --register-with-taints="" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556288 2579 flags.go:64] FLAG: --registry-burst="10" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556290 2579 flags.go:64] FLAG: --registry-qps="5" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556293 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556296 2579 flags.go:64] FLAG: --reserved-memory="" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556300 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556303 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556307 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556310 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556313 2579 flags.go:64] FLAG: --runonce="false" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556316 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 02:00:54.564873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556320 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556323 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556326 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556328 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556331 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556335 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556338 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556341 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556344 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556347 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556350 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556353 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556356 2579 flags.go:64] FLAG: --system-cgroups="" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556358 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556364 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556368 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556371 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556374 2579 flags.go:64] FLAG: --tls-min-version="" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556377 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556380 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556383 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556386 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556389 2579 flags.go:64] FLAG: --v="2" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556393 2579 flags.go:64] FLAG: --version="false" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556396 2579 flags.go:64] FLAG: --vmodule="" Jun 13 02:00:54.565988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556400 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.556403 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558400 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558419 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558423 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558427 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558431 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558435 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558438 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558440 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558443 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558446 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558449 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558451 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558454 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558457 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558459 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558463 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558465 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558468 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:54.566998 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558470 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558474 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558476 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558479 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558481 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558484 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558486 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558489 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558492 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558494 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558497 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558500 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558504 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558508 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558512 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558517 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558520 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558522 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558526 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558529 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:54.567518 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558532 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558534 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558537 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558539 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558542 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558545 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558548 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558550 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558553 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558556 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558558 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558561 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558564 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558566 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558569 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558571 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558574 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558576 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558579 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:54.568280 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558583 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558586 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558589 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558592 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558595 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558598 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558601 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558604 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558608 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558611 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558613 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558618 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558620 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558623 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558626 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558628 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558631 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558633 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558636 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:54.569104 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558638 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558642 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558647 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558650 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558653 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558656 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558659 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558661 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558664 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558667 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558669 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558672 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558675 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558677 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558679 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558682 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558684 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558687 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558690 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558692 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:54.569633 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558695 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558698 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.558702 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.559576 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.566810 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.566836 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.567713 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.567727 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567813 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567821 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567828 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567835 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567840 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567845 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567849 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:54.570498 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567853 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567857 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567862 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567866 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567871 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567875 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567879 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567883 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567887 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567891 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567896 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567899 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567904 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567908 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567912 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567919 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567924 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567930 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567935 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567940 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:54.571150 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567945 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567949 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567957 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567962 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567982 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567988 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567993 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.567998 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568003 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568007 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568012 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568016 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568021 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568025 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568030 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568035 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568039 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568044 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568048 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:54.571628 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568052 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568057 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568061 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568065 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568069 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568073 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568077 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568082 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568086 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568091 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568095 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568099 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568103 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568107 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568111 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568116 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568123 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568128 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568132 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568136 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:54.572221 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568140 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568144 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568148 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568153 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568157 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568161 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568165 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568170 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568174 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568181 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568186 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568191 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568196 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568200 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568205 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568210 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568214 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568219 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568223 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:54.572739 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568227 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568231 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568235 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568239 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568244 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568248 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568252 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568256 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568261 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568265 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568271 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568275 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568279 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568283 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.568291 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:54.573368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568469 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568476 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568481 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568485 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568490 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568495 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568502 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568508 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568513 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568517 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568522 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568526 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568530 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568534 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568538 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568543 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568547 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568551 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568555 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 02:00:54.573742 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568559 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568563 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568567 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568572 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568576 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568581 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568585 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568590 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568594 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568599 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568604 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568608 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568612 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568617 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568621 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568625 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568631 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568636 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568640 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 02:00:54.574273 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568645 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568649 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568653 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568658 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568662 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568666 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568670 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568674 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568679 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568683 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568687 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568691 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568695 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568702 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568707 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568712 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568717 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568721 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568726 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568731 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 02:00:54.574744 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568736 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568740 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568744 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568749 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568753 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568757 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568762 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568766 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568770 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568775 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568779 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568783 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568787 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568791 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568795 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568799 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568803 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568807 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568811 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568816 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 02:00:54.575268 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568820 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568824 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568828 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568833 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568837 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568841 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568844 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568849 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568853 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568857 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568862 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568866 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568870 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568874 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568879 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568883 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568887 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568891 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568896 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568900 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 02:00:54.575813 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:54.568904 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 02:00:54.576351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.568912 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 02:00:54.576351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.569080 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 02:00:54.576351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.571741 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 02:00:54.576351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.573039 2579 server.go:1019] "Starting client certificate rotation" Jun 13 02:00:54.576351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.573142 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 02:00:54.576351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.573171 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 02:00:54.576351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.576141 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 02:00:54.577234 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.577221 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 02:00:54.589654 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.589635 2579 log.go:25] "Validated CRI v1 runtime API" Jun 13 02:00:54.592890 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.592874 2579 log.go:25] "Validated CRI v1 image API" Jun 13 02:00:54.593754 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.593732 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 02:00:54.598927 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.598875 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 900e8bb6-dd7b-4f4f-8e7b-ab6339bf29f6:/dev/nvme0n1p3 f31a9f05-14d2-46e9-9575-409fbed2f8c9:/dev/nvme0n1p4] Jun 13 02:00:54.598927 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.598911 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 02:00:54.604756 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.604635 2579 manager.go:216] Machine: {Timestamp:2026-06-13 02:00:54.603485139 +0000 UTC m=+0.322701931 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095074 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2134e1d94e4230c135e25b59d9b1fa SystemUUID:ec2134e1-d94e-4230-c135-e25b59d9b1fa BootID:632b0f38-9523-45a4-b638-d61daa75125e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ae:26:0b:65:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ae:26:0b:65:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:b3:6b:8c:11:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 02:00:54.604756 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.604747 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 02:00:54.604914 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.604829 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 02:00:54.605238 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.605219 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 02:00:54.605898 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.605871 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 02:00:54.606072 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.605906 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 02:00:54.607170 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.607156 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 02:00:54.607245 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.607175 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 02:00:54.607245 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.607185 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 02:00:54.607874 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.607862 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 02:00:54.609113 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.609102 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 02:00:54.613092 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613079 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 13 02:00:54.613396 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613383 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 02:00:54.613469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613424 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 13 02:00:54.613469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613445 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 02:00:54.613469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613459 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 02:00:54.613586 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613472 2579 kubelet.go:398] "Adding apiserver pod source" Jun 13 02:00:54.613586 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613485 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 02:00:54.613850 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613837 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 02:00:54.613915 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.613861 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 02:00:54.616929 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.616913 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 02:00:54.618182 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618170 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 02:00:54.618232 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618202 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 02:00:54.618387 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618376 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 02:00:54.618420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618391 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 02:00:54.618420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618398 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 02:00:54.618420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618404 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 02:00:54.618420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618413 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 02:00:54.618420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618418 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 02:00:54.618962 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618953 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 02:00:54.619014 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618962 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 02:00:54.619014 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618984 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 02:00:54.619014 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.618990 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 02:00:54.619014 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.619008 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 02:00:54.619014 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.619015 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 02:00:54.619688 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.619679 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 02:00:54.619719 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.619688 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 02:00:54.622704 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.622678 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 02:00:54.622704 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.622688 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 02:00:54.622812 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.622722 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 02:00:54.623217 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.623206 2579 server.go:1268] "Started kubelet" Jun 13 02:00:54.623325 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.623279 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 02:00:54.623376 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.623348 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 02:00:54.623376 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.623344 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 02:00:54.624346 ip-10-0-132-107 systemd[1]: Started Kubernetes Kubelet. Jun 13 02:00:54.624950 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.624821 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wgmbl" Jun 13 02:00:54.624950 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.624897 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 02:00:54.625058 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.624968 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 13 02:00:54.628634 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.627715 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-107.ec2.internal.18b881838c83d5e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-107.ec2.internal,UID:ip-10-0-132-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-107.ec2.internal,},FirstTimestamp:2026-06-13 02:00:54.623180263 +0000 UTC m=+0.342397081,LastTimestamp:2026-06-13 02:00:54.623180263 +0000 UTC m=+0.342397081,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-107.ec2.internal,}" Jun 13 02:00:54.630994 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.630963 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 02:00:54.630994 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.630987 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 02:00:54.631172 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.631013 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 02:00:54.631880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.631859 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 02:00:54.631947 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.631884 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 02:00:54.632035 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.632023 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 13 02:00:54.632083 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.632037 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 13 02:00:54.632186 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.632166 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:54.632331 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.632300 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 02:00:54.632636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.632622 2579 factory.go:55] Registering systemd factory Jun 13 02:00:54.632738 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.632729 2579 factory.go:223] Registration of the systemd container factory successfully Jun 13 02:00:54.633084 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.633062 2579 factory.go:153] Registering CRI-O factory Jun 13 02:00:54.633156 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.633104 2579 factory.go:223] Registration of the crio container factory successfully Jun 13 02:00:54.633206 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.633174 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 02:00:54.633206 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.633199 2579 factory.go:103] Registering Raw factory Jun 13 02:00:54.633309 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.633222 2579 manager.go:1196] Started watching for new ooms in manager Jun 13 02:00:54.633732 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.633713 2579 manager.go:349] Starting recovery of all containers Jun 13 02:00:54.634362 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.634333 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wgmbl" Jun 13 02:00:54.634789 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.634763 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 02:00:54.634882 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.634858 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 02:00:54.645571 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.645461 2579 manager.go:354] Recovery completed Jun 13 02:00:54.646806 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.646787 2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 13 02:00:54.649771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.649760 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:54.652615 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.652596 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:54.652697 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.652630 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:54.652697 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.652645 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:54.653371 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.653358 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 02:00:54.653371 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.653369 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 02:00:54.653516 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.653384 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 13 02:00:54.653516 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.653378 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:54.655192 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.655172 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:54.655251 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.655209 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:54.655251 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.655224 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:54.655464 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.655451 2579 policy_none.go:49] "None policy: Start" Jun 13 02:00:54.655499 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.655471 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 02:00:54.655499 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.655486 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 02:00:54.657487 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.657477 2579 policy_none.go:47] "Start" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.689590 2579 manager.go:337] "Starting Device Plugin manager" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.689628 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.689638 2579 server.go:87] "Starting device plugin registration server" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.689881 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.689891 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.690005 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.690081 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.690089 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.690777 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.690791 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.690831 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.692004 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.692031 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.692047 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.692077 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 02:00:54.707388 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.693456 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:54.791040 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.790999 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:54.792306 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.792289 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal"] Jun 13 02:00:54.792365 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.792352 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:54.792865 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.792846 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:54.792963 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.792881 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:54.792963 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.792895 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:54.792963 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.792924 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.794734 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.794713 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:54.794832 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.794746 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:54.794832 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.794763 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:54.797011 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.796997 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:54.797070 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.797103 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797083 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:54.797760 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797746 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:54.797812 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797767 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:54.797812 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797776 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:54.797812 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797802 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:54.797916 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797821 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:54.797916 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.797834 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:54.798277 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.798262 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.798330 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.798287 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-107.ec2.internal\": node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:54.799792 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.799750 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.799792 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.799776 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 02:00:54.801431 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.801412 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientMemory" Jun 13 02:00:54.801514 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.801442 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 02:00:54.801514 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.801456 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeHasSufficientPID" Jun 13 02:00:54.813188 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.811931 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:54.824848 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.824824 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-107.ec2.internal\" not found" node="ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.829288 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.829269 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-107.ec2.internal\" not found" node="ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.833603 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.833586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4628685526487d628f38a3df1723bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal\" (UID: \"4d4628685526487d628f38a3df1723bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.833663 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.833610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/634f28cc59756781be738094c6f0422f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-107.ec2.internal\" (UID: \"634f28cc59756781be738094c6f0422f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.833663 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.833628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4628685526487d628f38a3df1723bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal\" (UID: \"4d4628685526487d628f38a3df1723bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.912352 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:54.912318 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:54.934227 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.934201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4628685526487d628f38a3df1723bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal\" (UID: \"4d4628685526487d628f38a3df1723bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.934306 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.934231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4628685526487d628f38a3df1723bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal\" (UID: \"4d4628685526487d628f38a3df1723bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.934306 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.934248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/634f28cc59756781be738094c6f0422f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-107.ec2.internal\" (UID: \"634f28cc59756781be738094c6f0422f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.934306 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.934288 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/634f28cc59756781be738094c6f0422f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-107.ec2.internal\" (UID: \"634f28cc59756781be738094c6f0422f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.934439 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.934301 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d4628685526487d628f38a3df1723bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal\" (UID: \"4d4628685526487d628f38a3df1723bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:54.934439 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:54.934330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4628685526487d628f38a3df1723bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal\" (UID: \"4d4628685526487d628f38a3df1723bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:55.013068 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.013019 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.113716 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.113642 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.126923 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.126894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:55.133030 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.133012 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" Jun 13 02:00:55.213750 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.213705 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.314313 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.314283 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.414870 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.414841 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.515425 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.515394 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.543759 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.543736 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:55.572193 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.572169 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 02:00:55.572768 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.572306 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 02:00:55.572768 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.572355 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 02:00:55.615664 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.615634 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.619540 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.619518 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:55.640782 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.640744 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 01:55:54 +0000 UTC" deadline="2028-03-29 08:27:14.818119724 +0000 UTC" Jun 13 02:00:55.640782 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.640777 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15726h26m19.177346028s" Jun 13 02:00:55.710391 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:55.710358 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634f28cc59756781be738094c6f0422f.slice/crio-4b377d1e390f1500280b9240f1a123e1cebf09ecde9e437cc5eeba06eb0a6291 WatchSource:0}: Error finding container 4b377d1e390f1500280b9240f1a123e1cebf09ecde9e437cc5eeba06eb0a6291: Status 404 returned error can't find the container with id 4b377d1e390f1500280b9240f1a123e1cebf09ecde9e437cc5eeba06eb0a6291 Jun 13 02:00:55.710743 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:55.710723 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4628685526487d628f38a3df1723bd.slice/crio-569b028bc93ca81ef72093af628227c518439686aad7838b9079fe902836f173 WatchSource:0}: Error finding container 569b028bc93ca81ef72093af628227c518439686aad7838b9079fe902836f173: Status 404 returned error can't find the container with id 569b028bc93ca81ef72093af628227c518439686aad7838b9079fe902836f173 Jun 13 02:00:55.714466 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:55.714449 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:00:55.716023 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.716003 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.816829 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.816785 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:55.917322 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:55.917284 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:56.017836 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.017766 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:56.118604 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.118572 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-107.ec2.internal\" not found" Jun 13 02:00:56.131609 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.131576 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:56.132431 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.132412 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" Jun 13 02:00:56.142641 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.142604 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 02:00:56.144656 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.144635 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" Jun 13 02:00:56.152676 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.152652 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 02:00:56.614585 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.614554 2579 apiserver.go:52] "Watching apiserver" Jun 13 02:00:56.623042 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.623012 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 02:00:56.624277 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.624250 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-bqn6k","openshift-network-operator/iptables-alerter-bp2w4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb","openshift-cluster-node-tuning-operator/tuned-zfhx7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-dv44v","openshift-multus/network-metrics-daemon-vl5wj","openshift-network-diagnostics/network-check-target-bdz66","openshift-ovn-kubernetes/ovnkube-node-gz2ss","kube-system/global-pull-secret-syncer-s4hxm","kube-system/konnectivity-agent-twdwh","kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal","openshift-dns/node-resolver-fgwvw","openshift-image-registry/node-ca-w5kcn"] Jun 13 02:00:56.627030 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.626906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:56.627363 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.627182 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:00:56.629175 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.629113 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.631327 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.631306 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 02:00:56.631875 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.631434 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.631875 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.631594 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 02:00:56.632945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.632155 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 02:00:56.632945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.632206 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5nprx\"" Jun 13 02:00:56.634420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.634078 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 02:00:56.634420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.634112 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s6kg\"" Jun 13 02:00:56.634420 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.634384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 02:00:56.635115 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.635094 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 02:00:56.635632 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.635613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.637820 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.637796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.638120 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.638105 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:00:56.638375 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.638354 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 02:00:56.638456 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.638359 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ml7hz\"" Jun 13 02:00:56.640063 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.640047 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.640670 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.640648 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 02:00:56.640770 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.640698 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 02:00:56.640770 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.640763 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-whkfq\"" Jun 13 02:00:56.640886 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.640874 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 02:00:56.641854 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.641834 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 02:00:56.642424 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.642407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.642540 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.642521 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 02:00:56.642863 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.642844 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdgbc\"" Jun 13 02:00:56.642951 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.642883 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 02:00:56.642951 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.642905 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 02:00:56.642951 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.642921 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 02:00:56.643117 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.642999 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 02:00:56.644366 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-sys-fs\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.644469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9z65\" (UniqueName: \"kubernetes.io/projected/d5444aae-da03-43ef-8c58-5d865c7afb50-kube-api-access-j9z65\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.644469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysctl-d\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysctl-conf\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-sys\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644469 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-lib-modules\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-socket-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-systemd\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-run\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-var-lib-kubelet\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-tuned\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.644736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644759 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-device-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-kubernetes\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-host\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d62e179-f443-438e-a3ce-7d285b31a67f-tmp\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqjd2\" (UniqueName: \"kubernetes.io/projected/4d62e179-f443-438e-a3ce-7d285b31a67f-kube-api-access-gqjd2\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65b3a233-2155-4b55-ae6c-2d6f154e4327-agent-certs\") pod \"konnectivity-agent-twdwh\" (UID: \"65b3a233-2155-4b55-ae6c-2d6f154e4327\") " pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644934 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z72bg\"" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65b3a233-2155-4b55-ae6c-2d6f154e4327-konnectivity-ca\") pod \"konnectivity-agent-twdwh\" (UID: \"65b3a233-2155-4b55-ae6c-2d6f154e4327\") " pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.644991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-modprobe-d\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.645012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysconfig\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.645035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l4k7\" (UniqueName: \"kubernetes.io/projected/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-kube-api-access-7l4k7\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.645073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-registration-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.645177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.645149 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.646715 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.646595 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 02:00:56.646715 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.646625 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 02:00:56.646715 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.646668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 02:00:56.646715 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.646686 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 02:00:56.647006 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.646639 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 02:00:56.647798 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.647307 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.648020 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.647986 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 02:00:56.648020 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.648006 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dk2b6\"" Jun 13 02:00:56.648221 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.648056 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 02:00:56.650051 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.649768 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 02:00:56.650051 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.649950 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 02:00:56.650244 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.650180 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:00:56.650439 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.650415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.650551 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.650414 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tdmj2\"" Jun 13 02:00:56.650624 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.650600 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:00:56.652922 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.652570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.655073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.654902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:00:56.655073 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.655061 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:00:56.655283 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.655112 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x765p\"" Jun 13 02:00:56.655406 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.655352 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 02:00:56.662489 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.662465 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f42j5" Jun 13 02:00:56.669294 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.669275 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f42j5" Jun 13 02:00:56.697152 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.697105 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" event={"ID":"634f28cc59756781be738094c6f0422f","Type":"ContainerStarted","Data":"4b377d1e390f1500280b9240f1a123e1cebf09ecde9e437cc5eeba06eb0a6291"} Jun 13 02:00:56.698539 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.698488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" event={"ID":"4d4628685526487d628f38a3df1723bd","Type":"ContainerStarted","Data":"569b028bc93ca81ef72093af628227c518439686aad7838b9079fe902836f173"} Jun 13 02:00:56.734242 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.734213 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 02:00:56.745638 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d62e179-f443-438e-a3ce-7d285b31a67f-tmp\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.745638 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-socket-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.745884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-systemd\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.745884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-var-lib-kubelet\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.745884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovnkube-script-lib\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.745884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745756 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-systemd\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.745884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-device-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.745884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-system-cni-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.745884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745859 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-device-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745891 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745915 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-socket-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-node-log\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4f4d864-e019-4901-8bb1-950b3602add4-hosts-file\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.745967 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-var-lib-kubelet\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84glt\" (UniqueName: \"kubernetes.io/projected/b4f4d864-e019-4901-8bb1-950b3602add4-kube-api-access-84glt\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746039 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65b3a233-2155-4b55-ae6c-2d6f154e4327-konnectivity-ca\") pod \"konnectivity-agent-twdwh\" (UID: \"65b3a233-2155-4b55-ae6c-2d6f154e4327\") " pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-modprobe-d\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-socket-dir-parent\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d32077bd-301a-4aa2-8c38-441f240a4892-multus-daemon-config\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-system-cni-dir\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.746228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcd88\" (UniqueName: \"kubernetes.io/projected/cbe49d38-3643-4ad0-b4ef-951aa7985161-kube-api-access-mcd88\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-sys-fs\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-modprobe-d\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-lib-modules\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-kubelet\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovn-node-metrics-cert\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lms2\" (UniqueName: \"kubernetes.io/projected/232c873f-7a44-4e36-93ce-c6d1f6f5a855-kube-api-access-4lms2\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b246934d-7e12-4daf-80d9-a50d13b681df-kubelet-config\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b246934d-7e12-4daf-80d9-a50d13b681df-dbus\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746417 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-lib-modules\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-run\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-cni-multus\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.746500 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.746561 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:00:57.246533237 +0000 UTC m=+2.965749996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746574 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.746859 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-host\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-etc-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-run\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746643 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-sys-fs\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746636 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/65b3a233-2155-4b55-ae6c-2d6f154e4327-konnectivity-ca\") pod \"konnectivity-agent-twdwh\" (UID: \"65b3a233-2155-4b55-ae6c-2d6f154e4327\") " pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746702 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-host\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65b3a233-2155-4b55-ae6c-2d6f154e4327-agent-certs\") pod \"konnectivity-agent-twdwh\" (UID: \"65b3a233-2155-4b55-ae6c-2d6f154e4327\") " pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-conf-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr8s8\" (UniqueName: \"kubernetes.io/projected/d32077bd-301a-4aa2-8c38-441f240a4892-kube-api-access-wr8s8\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-kubelet\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-run-netns\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe49d38-3643-4ad0-b4ef-951aa7985161-host\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysctl-d\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-sys\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.746986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d32077bd-301a-4aa2-8c38-441f240a4892-cni-binary-copy\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.747677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-cni-bin\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2lg\" (UniqueName: \"kubernetes.io/projected/753b8555-3e59-45a6-b8f4-46c97750e0ff-kube-api-access-bd2lg\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747034 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-sys\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-systemd\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysctl-d\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747149 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-k8s-cni-cncf-io\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-etc-kubernetes\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-etc-selinux\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbe49d38-3643-4ad0-b4ef-951aa7985161-serviceca\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-kubernetes\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqjd2\" (UniqueName: \"kubernetes.io/projected/4d62e179-f443-438e-a3ce-7d285b31a67f-kube-api-access-gqjd2\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-cnibin\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747366 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-kubernetes\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-os-release\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-cni-bin\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.748412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysconfig\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bcfa73-9c95-4822-94b2-5266d5979604-host-slash\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-os-release\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747521 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysconfig\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-hostroot\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-multus-certs\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-var-lib-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-cni-netd\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l4k7\" (UniqueName: \"kubernetes.io/projected/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-kube-api-access-7l4k7\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-registration-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9z65\" (UniqueName: \"kubernetes.io/projected/d5444aae-da03-43ef-8c58-5d865c7afb50-kube-api-access-j9z65\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bcfa73-9c95-4822-94b2-5266d5979604-iptables-alerter-script\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-systemd-units\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-slash\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-run-ovn-kubernetes\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:00:56.749258 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747903 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5444aae-da03-43ef-8c58-5d865c7afb50-registration-dir\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.747988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5rx7\" (UniqueName: \"kubernetes.io/projected/53bcfa73-9c95-4822-94b2-5266d5979604-kube-api-access-m5rx7\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748018 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-netns\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-ovn\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-cni-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-env-overrides\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4f4d864-e019-4901-8bb1-950b3602add4-tmp-dir\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-log-socket\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysctl-conf\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-tuned\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-cnibin\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovnkube-config\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.748392 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-sysctl-conf\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.749945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.749467 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d62e179-f443-438e-a3ce-7d285b31a67f-tmp\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.750591 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.750268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/65b3a233-2155-4b55-ae6c-2d6f154e4327-agent-certs\") pod \"konnectivity-agent-twdwh\" (UID: \"65b3a233-2155-4b55-ae6c-2d6f154e4327\") " pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.750824 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.750800 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d62e179-f443-438e-a3ce-7d285b31a67f-etc-tuned\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.755839 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.755819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqjd2\" (UniqueName: \"kubernetes.io/projected/4d62e179-f443-438e-a3ce-7d285b31a67f-kube-api-access-gqjd2\") pod \"tuned-zfhx7\" (UID: \"4d62e179-f443-438e-a3ce-7d285b31a67f\") " pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.756323 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.756225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9z65\" (UniqueName: \"kubernetes.io/projected/d5444aae-da03-43ef-8c58-5d865c7afb50-kube-api-access-j9z65\") pod \"aws-ebs-csi-driver-node-8dngb\" (UID: \"d5444aae-da03-43ef-8c58-5d865c7afb50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.756920 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.756901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l4k7\" (UniqueName: \"kubernetes.io/projected/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-kube-api-access-7l4k7\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:56.849603 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-socket-dir-parent\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.849790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d32077bd-301a-4aa2-8c38-441f240a4892-multus-daemon-config\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.849790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-system-cni-dir\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.849790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcd88\" (UniqueName: \"kubernetes.io/projected/cbe49d38-3643-4ad0-b4ef-951aa7985161-kube-api-access-mcd88\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.849790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849711 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-socket-dir-parent\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.849790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849776 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-system-cni-dir\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.850066 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-kubelet\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850066 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovn-node-metrics-cert\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850066 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lms2\" (UniqueName: \"kubernetes.io/projected/232c873f-7a44-4e36-93ce-c6d1f6f5a855-kube-api-access-4lms2\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850066 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b246934d-7e12-4daf-80d9-a50d13b681df-kubelet-config\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.850066 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849913 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-kubelet\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850066 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.849929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b246934d-7e12-4daf-80d9-a50d13b681df-dbus\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850096 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b246934d-7e12-4daf-80d9-a50d13b681df-dbus\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-cni-multus\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b246934d-7e12-4daf-80d9-a50d13b681df-kubelet-config\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-etc-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-cni-multus\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850221 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-etc-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-conf-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr8s8\" (UniqueName: \"kubernetes.io/projected/d32077bd-301a-4aa2-8c38-441f240a4892-kube-api-access-wr8s8\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-conf-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-kubelet\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-run-netns\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d32077bd-301a-4aa2-8c38-441f240a4892-multus-daemon-config\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.850384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-kubelet\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe49d38-3643-4ad0-b4ef-951aa7985161-host\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d32077bd-301a-4aa2-8c38-441f240a4892-cni-binary-copy\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-run-netns\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850480 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe49d38-3643-4ad0-b4ef-951aa7985161-host\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-cni-bin\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2lg\" (UniqueName: \"kubernetes.io/projected/753b8555-3e59-45a6-b8f4-46c97750e0ff-kube-api-access-bd2lg\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-var-lib-cni-bin\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-systemd\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-systemd\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-k8s-cni-cncf-io\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-etc-kubernetes\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbe49d38-3643-4ad0-b4ef-951aa7985161-serviceca\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850730 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-k8s-cni-cncf-io\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-cnibin\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-etc-kubernetes\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-os-release\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.851190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-cni-bin\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850873 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-os-release\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850818 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-cnibin\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bcfa73-9c95-4822-94b2-5266d5979604-host-slash\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-os-release\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850891 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-cni-bin\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d32077bd-301a-4aa2-8c38-441f240a4892-cni-binary-copy\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850945 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53bcfa73-9c95-4822-94b2-5266d5979604-host-slash\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-hostroot\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.850997 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-hostroot\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-multus-certs\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851012 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-os-release\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-var-lib-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-cni-netd\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851056 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-multus-certs\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bcfa73-9c95-4822-94b2-5266d5979604-iptables-alerter-script\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.852034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851096 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-var-lib-openvswitch\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-systemd-units\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-cni-netd\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-slash\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851141 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-systemd-units\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851170 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-slash\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-run-ovn-kubernetes\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbe49d38-3643-4ad0-b4ef-951aa7985161-serviceca\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5rx7\" (UniqueName: \"kubernetes.io/projected/53bcfa73-9c95-4822-94b2-5266d5979604-kube-api-access-m5rx7\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851251 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-host-run-ovn-kubernetes\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-netns\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-ovn\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-cni-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851347 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-host-run-netns\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-env-overrides\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.852866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4f4d864-e019-4901-8bb1-950b3602add4-tmp-dir\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-multus-cni-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-log-socket\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-cnibin\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851465 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-run-ovn\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovnkube-config\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-cnibin\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovnkube-script-lib\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53bcfa73-9c95-4822-94b2-5266d5979604-iptables-alerter-script\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-system-cni-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-node-log\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4f4d864-e019-4901-8bb1-950b3602add4-hosts-file\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84glt\" (UniqueName: \"kubernetes.io/projected/b4f4d864-e019-4901-8bb1-950b3602add4-kube-api-access-84glt\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.851721 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:56.853705 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.851763 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret podName:b246934d-7e12-4daf-80d9-a50d13b681df nodeName:}" failed. No retries permitted until 2026-06-13 02:00:57.351750621 +0000 UTC m=+3.070967380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret") pod "global-pull-secret-syncer-s4hxm" (UID: "b246934d-7e12-4daf-80d9-a50d13b681df") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4f4d864-e019-4901-8bb1-950b3602add4-tmp-dir\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851908 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-env-overrides\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d32077bd-301a-4aa2-8c38-441f240a4892-system-cni-dir\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/753b8555-3e59-45a6-b8f4-46c97750e0ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.851993 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-log-socket\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.852008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.852045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4f4d864-e019-4901-8bb1-950b3602add4-hosts-file\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.852059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovnkube-script-lib\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.852070 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/232c873f-7a44-4e36-93ce-c6d1f6f5a855-node-log\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.852341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/753b8555-3e59-45a6-b8f4-46c97750e0ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.852373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovnkube-config\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.854535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.852847 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/232c873f-7a44-4e36-93ce-c6d1f6f5a855-ovn-node-metrics-cert\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.858369 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.858345 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:56.858484 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.858373 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:56.858484 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.858387 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m4qk5 for pod openshift-network-diagnostics/network-check-target-bdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:56.858484 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:56.858449 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5 podName:d96410b2-61af-4eeb-a41e-bd47f6bc5fa3 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:57.358430857 +0000 UTC m=+3.077647629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m4qk5" (UniqueName: "kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5") pod "network-check-target-bdz66" (UID: "d96410b2-61af-4eeb-a41e-bd47f6bc5fa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:56.858945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.858900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr8s8\" (UniqueName: \"kubernetes.io/projected/d32077bd-301a-4aa2-8c38-441f240a4892-kube-api-access-wr8s8\") pod \"multus-bqn6k\" (UID: \"d32077bd-301a-4aa2-8c38-441f240a4892\") " pod="openshift-multus/multus-bqn6k" Jun 13 02:00:56.859307 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.859267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcd88\" (UniqueName: \"kubernetes.io/projected/cbe49d38-3643-4ad0-b4ef-951aa7985161-kube-api-access-mcd88\") pod \"node-ca-w5kcn\" (UID: \"cbe49d38-3643-4ad0-b4ef-951aa7985161\") " pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.859445 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.859415 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2lg\" (UniqueName: \"kubernetes.io/projected/753b8555-3e59-45a6-b8f4-46c97750e0ff-kube-api-access-bd2lg\") pod \"multus-additional-cni-plugins-dv44v\" (UID: \"753b8555-3e59-45a6-b8f4-46c97750e0ff\") " pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.859884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.859844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lms2\" (UniqueName: \"kubernetes.io/projected/232c873f-7a44-4e36-93ce-c6d1f6f5a855-kube-api-access-4lms2\") pod \"ovnkube-node-gz2ss\" (UID: \"232c873f-7a44-4e36-93ce-c6d1f6f5a855\") " pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.860156 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.860133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5rx7\" (UniqueName: \"kubernetes.io/projected/53bcfa73-9c95-4822-94b2-5266d5979604-kube-api-access-m5rx7\") pod \"iptables-alerter-bp2w4\" (UID: \"53bcfa73-9c95-4822-94b2-5266d5979604\") " pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:56.860395 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.860377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84glt\" (UniqueName: \"kubernetes.io/projected/b4f4d864-e019-4901-8bb1-950b3602add4-kube-api-access-84glt\") pod \"node-resolver-fgwvw\" (UID: \"b4f4d864-e019-4901-8bb1-950b3602add4\") " pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.940864 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.940833 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:56.942995 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.942956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:00:56.951279 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.951255 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" Jun 13 02:00:56.958917 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.958893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" Jun 13 02:00:56.966811 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.966788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5kcn" Jun 13 02:00:56.974017 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.973997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dv44v" Jun 13 02:00:56.982735 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.982712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:00:56.989514 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.989496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fgwvw" Jun 13 02:00:56.999318 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:56.999299 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bp2w4" Jun 13 02:00:57.004357 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.004332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqn6k" Jun 13 02:00:57.255168 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.255095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:57.255306 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.255217 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:57.255306 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.255269 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:00:58.255256578 +0000 UTC m=+3.974473336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:57.355915 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.355880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:57.356100 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.356042 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:57.356150 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.356107 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret podName:b246934d-7e12-4daf-80d9-a50d13b681df nodeName:}" failed. No retries permitted until 2026-06-13 02:00:58.356092824 +0000 UTC m=+4.075309586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret") pod "global-pull-secret-syncer-s4hxm" (UID: "b246934d-7e12-4daf-80d9-a50d13b681df") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:57.456534 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.456500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:00:57.456710 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.456687 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:57.456710 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.456707 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:57.456800 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.456721 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m4qk5 for pod openshift-network-diagnostics/network-check-target-bdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:57.456800 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:57.456781 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5 podName:d96410b2-61af-4eeb-a41e-bd47f6bc5fa3 nodeName:}" failed. No retries permitted until 2026-06-13 02:00:58.456764509 +0000 UTC m=+4.175981275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m4qk5" (UniqueName: "kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5") pod "network-check-target-bdz66" (UID: "d96410b2-61af-4eeb-a41e-bd47f6bc5fa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:57.643605 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:57.643570 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d62e179_f443_438e_a3ce_7d285b31a67f.slice/crio-cd94fae32aa23b74f0d4cabed664bd36972c37975979ca457fb71be5c21da3ab WatchSource:0}: Error finding container cd94fae32aa23b74f0d4cabed664bd36972c37975979ca457fb71be5c21da3ab: Status 404 returned error can't find the container with id cd94fae32aa23b74f0d4cabed664bd36972c37975979ca457fb71be5c21da3ab Jun 13 02:00:57.646554 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:57.646520 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f4d864_e019_4901_8bb1_950b3602add4.slice/crio-2750f2a11f7a728fb9d211d5cb5f3a7fc7deab453dd968ef55ca4a565f3e33dd WatchSource:0}: Error finding container 2750f2a11f7a728fb9d211d5cb5f3a7fc7deab453dd968ef55ca4a565f3e33dd: Status 404 returned error can't find the container with id 2750f2a11f7a728fb9d211d5cb5f3a7fc7deab453dd968ef55ca4a565f3e33dd Jun 13 02:00:57.649575 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:57.649391 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232c873f_7a44_4e36_93ce_c6d1f6f5a855.slice/crio-e7894ed8f16b50706bc2b0833a3d1cff3238e814eec6b7990d31a89762a61688 WatchSource:0}: Error finding container e7894ed8f16b50706bc2b0833a3d1cff3238e814eec6b7990d31a89762a61688: Status 404 returned error can't find the container with id e7894ed8f16b50706bc2b0833a3d1cff3238e814eec6b7990d31a89762a61688 Jun 13 02:00:57.650483 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:00:57.650185 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5444aae_da03_43ef_8c58_5d865c7afb50.slice/crio-4f2fefd9a11aca86917191f3b40ebe28afb4f9c32dc4887174753c5fa4575f3d WatchSource:0}: Error finding container 4f2fefd9a11aca86917191f3b40ebe28afb4f9c32dc4887174753c5fa4575f3d: Status 404 returned error can't find the container with id 4f2fefd9a11aca86917191f3b40ebe28afb4f9c32dc4887174753c5fa4575f3d Jun 13 02:00:57.672717 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.672665 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:55:56 +0000 UTC" deadline="2027-11-12 23:58:36.426737573 +0000 UTC" Jun 13 02:00:57.672717 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.672707 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12429h57m38.754033458s" Jun 13 02:00:57.700751 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.700716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-twdwh" event={"ID":"65b3a233-2155-4b55-ae6c-2d6f154e4327","Type":"ContainerStarted","Data":"de8bf535037dc61bb3a830b693ca58445b07acdf22d4f635f59db262043b72d1"} Jun 13 02:00:57.705224 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.705198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerStarted","Data":"8e24dfec3c64490c52e0582ef46a528ba90d11022caf3f1bd3f96022dfbe0479"} Jun 13 02:00:57.707867 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.707665 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bp2w4" event={"ID":"53bcfa73-9c95-4822-94b2-5266d5979604","Type":"ContainerStarted","Data":"fa4ff206851bab16c09c9dd1bef4203c6aa122366e3cd8c25f660311e15b4268"} Jun 13 02:00:57.708760 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.708741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" event={"ID":"d5444aae-da03-43ef-8c58-5d865c7afb50","Type":"ContainerStarted","Data":"4f2fefd9a11aca86917191f3b40ebe28afb4f9c32dc4887174753c5fa4575f3d"} Jun 13 02:00:57.709912 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.709888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"e7894ed8f16b50706bc2b0833a3d1cff3238e814eec6b7990d31a89762a61688"} Jun 13 02:00:57.710898 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.710879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fgwvw" event={"ID":"b4f4d864-e019-4901-8bb1-950b3602add4","Type":"ContainerStarted","Data":"2750f2a11f7a728fb9d211d5cb5f3a7fc7deab453dd968ef55ca4a565f3e33dd"} Jun 13 02:00:57.711987 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.711952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" event={"ID":"4d62e179-f443-438e-a3ce-7d285b31a67f","Type":"ContainerStarted","Data":"cd94fae32aa23b74f0d4cabed664bd36972c37975979ca457fb71be5c21da3ab"} Jun 13 02:00:57.712951 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.712933 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqn6k" event={"ID":"d32077bd-301a-4aa2-8c38-441f240a4892","Type":"ContainerStarted","Data":"69f66d2dae060ad37023b46c42aceb5ba5a72d3d5200055090d9a18fc6ac2c31"} Jun 13 02:00:57.713924 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.713904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5kcn" event={"ID":"cbe49d38-3643-4ad0-b4ef-951aa7985161","Type":"ContainerStarted","Data":"285698c230b68c0f9cbe29954257c4d698afc626fd5f53755aaecf094bdb284f"} Jun 13 02:00:57.856511 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:57.856487 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 02:00:58.268568 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.268519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:58.268764 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.268696 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:58.268832 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.268770 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:01:00.268750759 +0000 UTC m=+5.987967520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:00:58.369473 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.368853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:58.369473 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.369069 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:58.369473 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.369128 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret podName:b246934d-7e12-4daf-80d9-a50d13b681df nodeName:}" failed. No retries permitted until 2026-06-13 02:01:00.3691094 +0000 UTC m=+6.088326178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret") pod "global-pull-secret-syncer-s4hxm" (UID: "b246934d-7e12-4daf-80d9-a50d13b681df") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:00:58.470043 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.469317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:00:58.470043 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.469527 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:00:58.470043 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.469553 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:00:58.470043 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.469566 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m4qk5 for pod openshift-network-diagnostics/network-check-target-bdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:58.470043 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.469625 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5 podName:d96410b2-61af-4eeb-a41e-bd47f6bc5fa3 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:00.469607403 +0000 UTC m=+6.188824168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m4qk5" (UniqueName: "kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5") pod "network-check-target-bdz66" (UID: "d96410b2-61af-4eeb-a41e-bd47f6bc5fa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:00:58.673172 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.673111 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 01:55:56 +0000 UTC" deadline="2028-03-11 13:45:33.663907254 +0000 UTC" Jun 13 02:00:58.673172 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.673172 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15299h44m34.990739822s" Jun 13 02:00:58.692460 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.692431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:00:58.692628 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.692551 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:00:58.692994 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.692951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:00:58.693102 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.693079 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:00:58.693161 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.693147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:00:58.693233 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:00:58.693216 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:00:58.731655 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.731618 2579 generic.go:356] "Generic (PLEG): container finished" podID="4d4628685526487d628f38a3df1723bd" containerID="13d16180375e1ec206ab67401f7ffcbee99483320c6107db072a22d634cacc86" exitCode=0 Jun 13 02:00:58.731863 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.731716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" event={"ID":"4d4628685526487d628f38a3df1723bd","Type":"ContainerDied","Data":"13d16180375e1ec206ab67401f7ffcbee99483320c6107db072a22d634cacc86"} Jun 13 02:00:58.755364 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.754823 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" event={"ID":"634f28cc59756781be738094c6f0422f","Type":"ContainerStarted","Data":"f63d9be4dddf0f1e0a711dde583f034a3d74db469ab458f1cbaed069f98a63ae"} Jun 13 02:00:58.771921 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:58.771851 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-107.ec2.internal" podStartSLOduration=2.771828842 podStartE2EDuration="2.771828842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:58.771737327 +0000 UTC m=+4.490954113" watchObservedRunningTime="2026-06-13 02:00:58.771828842 +0000 UTC m=+4.491045606" Jun 13 02:00:59.793565 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:59.793326 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" event={"ID":"4d4628685526487d628f38a3df1723bd","Type":"ContainerStarted","Data":"df155931775f351cb65fa59289bac5d3b7c3da82c4e95381ecf2be37c9a2b3ab"} Jun 13 02:00:59.812572 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:00:59.812443 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-107.ec2.internal" podStartSLOduration=3.812421379 podStartE2EDuration="3.812421379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:00:59.811785804 +0000 UTC m=+5.531002596" watchObservedRunningTime="2026-06-13 02:00:59.812421379 +0000 UTC m=+5.531638161" Jun 13 02:01:00.290254 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:00.290210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:00.290445 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.290376 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:00.290522 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.290448 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:01:04.290427546 +0000 UTC m=+10.009644306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:00.391327 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:00.391286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:00.391512 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.391488 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:00.391641 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.391550 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret podName:b246934d-7e12-4daf-80d9-a50d13b681df nodeName:}" failed. No retries permitted until 2026-06-13 02:01:04.391533778 +0000 UTC m=+10.110750552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret") pod "global-pull-secret-syncer-s4hxm" (UID: "b246934d-7e12-4daf-80d9-a50d13b681df") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:00.493165 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:00.492434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:00.493165 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.492663 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:01:00.493165 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.492688 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:01:00.493165 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.492702 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m4qk5 for pod openshift-network-diagnostics/network-check-target-bdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:00.493165 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.492762 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5 podName:d96410b2-61af-4eeb-a41e-bd47f6bc5fa3 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:04.492744315 +0000 UTC m=+10.211961074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m4qk5" (UniqueName: "kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5") pod "network-check-target-bdz66" (UID: "d96410b2-61af-4eeb-a41e-bd47f6bc5fa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:00.697898 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:00.697198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:00.697898 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.697328 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:00.697898 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:00.697668 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:00.697898 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.697758 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:00.697898 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:00.697799 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:00.697898 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:00.697862 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:02.696652 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:02.696595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:02.696652 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:02.696613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:02.697199 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:02.696766 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:02.697199 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:02.696598 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:02.697199 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:02.696877 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:02.697199 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:02.696942 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:04.326649 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:04.326615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:04.327177 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.326790 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:04.327177 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.326882 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:01:12.326862019 +0000 UTC m=+18.046078781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:04.427652 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:04.427584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:04.427819 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.427742 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:04.427819 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.427811 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret podName:b246934d-7e12-4daf-80d9-a50d13b681df nodeName:}" failed. No retries permitted until 2026-06-13 02:01:12.427794422 +0000 UTC m=+18.147011183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret") pod "global-pull-secret-syncer-s4hxm" (UID: "b246934d-7e12-4daf-80d9-a50d13b681df") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:04.528863 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:04.528296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:04.528863 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.528446 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:01:04.528863 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.528466 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:01:04.528863 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.528479 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m4qk5 for pod openshift-network-diagnostics/network-check-target-bdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:04.528863 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.528536 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5 podName:d96410b2-61af-4eeb-a41e-bd47f6bc5fa3 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:12.528517239 +0000 UTC m=+18.247734078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m4qk5" (UniqueName: "kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5") pod "network-check-target-bdz66" (UID: "d96410b2-61af-4eeb-a41e-bd47f6bc5fa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:04.692274 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:04.692231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:04.692447 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.692367 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:04.692787 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:04.692754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:04.692906 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.692860 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:04.692997 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:04.692920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:04.693059 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:04.693038 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:06.692480 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:06.692442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:06.692480 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:06.692460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:06.692480 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:06.692442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:06.693139 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:06.692603 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:06.693139 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:06.692657 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:06.693139 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:06.692712 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:08.693100 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:08.693058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:08.693100 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:08.693099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:08.693576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:08.693065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:08.693576 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:08.693200 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:08.693576 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:08.693272 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:08.693576 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:08.693327 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:10.693010 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:10.692955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:10.693496 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:10.693091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:10.693496 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:10.693101 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:10.693496 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:10.693254 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:10.693496 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:10.693259 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:10.693496 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:10.693352 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:12.385771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:12.385734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:12.386214 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.385851 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:12.386214 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.385918 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:01:28.385903014 +0000 UTC m=+34.105119773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:12.486090 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:12.486052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:12.486270 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.486214 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:12.486331 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.486285 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret podName:b246934d-7e12-4daf-80d9-a50d13b681df nodeName:}" failed. No retries permitted until 2026-06-13 02:01:28.486269832 +0000 UTC m=+34.205486592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret") pod "global-pull-secret-syncer-s4hxm" (UID: "b246934d-7e12-4daf-80d9-a50d13b681df") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:12.587280 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:12.587234 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:12.587461 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.587380 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:01:12.587461 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.587404 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:01:12.587461 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.587417 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m4qk5 for pod openshift-network-diagnostics/network-check-target-bdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:12.587627 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.587484 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5 podName:d96410b2-61af-4eeb-a41e-bd47f6bc5fa3 nodeName:}" failed. No retries permitted until 2026-06-13 02:01:28.587464833 +0000 UTC m=+34.306681610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m4qk5" (UniqueName: "kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5") pod "network-check-target-bdz66" (UID: "d96410b2-61af-4eeb-a41e-bd47f6bc5fa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:12.692543 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:12.692505 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:12.692543 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:12.692531 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:12.692798 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:12.692592 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:12.692798 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.692702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:12.692798 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.692735 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:12.692961 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:12.692831 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:14.695627 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:14.695594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:14.696074 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:14.695697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:14.696074 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:14.695705 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:14.696074 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:14.695731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:14.696074 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:14.695839 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:14.696074 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:14.695932 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:16.693088 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.692758 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:16.693887 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.692759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:16.693887 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:16.693168 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:16.693887 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.692759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:16.693887 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:16.693235 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:16.693887 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:16.693341 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:16.830485 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.830451 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fgwvw" event={"ID":"b4f4d864-e019-4901-8bb1-950b3602add4","Type":"ContainerStarted","Data":"448183c8e7d82cb757d835ba49c2a8dee332f9ee21ca1f13067c95c801cddba1"} Jun 13 02:01:16.832247 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.832200 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" event={"ID":"4d62e179-f443-438e-a3ce-7d285b31a67f","Type":"ContainerStarted","Data":"9b4d279f6823e8d6f8d400c1bf2e01d0b7f94ad74bf7f680494bda76247fec9f"} Jun 13 02:01:16.833829 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.833802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqn6k" event={"ID":"d32077bd-301a-4aa2-8c38-441f240a4892","Type":"ContainerStarted","Data":"4705eac68258e8cb1c156108a20f556f24a9836cd7a5d37350f8785b1ca5043f"} Jun 13 02:01:16.835819 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.835783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5kcn" event={"ID":"cbe49d38-3643-4ad0-b4ef-951aa7985161","Type":"ContainerStarted","Data":"22667d41c8a34a91f7ce2583abf79c385619bcb2af154e036bc0d8bae5b36cac"} Jun 13 02:01:16.837594 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.837571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-twdwh" event={"ID":"65b3a233-2155-4b55-ae6c-2d6f154e4327","Type":"ContainerStarted","Data":"3f5cf7bd332d9e7232a3be917ff426cf1b38ca134d70f9798f82db798fd3c1df"} Jun 13 02:01:16.839488 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.839460 2579 generic.go:356] "Generic (PLEG): container finished" podID="753b8555-3e59-45a6-b8f4-46c97750e0ff" containerID="a3d2d733935b39c1c68c7a0191e74bb4a172b2d1e8a2a099a6ad18b60af953ad" exitCode=0 Jun 13 02:01:16.839587 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.839542 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerDied","Data":"a3d2d733935b39c1c68c7a0191e74bb4a172b2d1e8a2a099a6ad18b60af953ad"} Jun 13 02:01:16.842229 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.842207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" event={"ID":"d5444aae-da03-43ef-8c58-5d865c7afb50","Type":"ContainerStarted","Data":"2e1f816c580099af1216c560a609619fdc14ac86ef13b3301ccccf4f901f78d4"} Jun 13 02:01:16.845197 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.845177 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:01:16.845550 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.845530 2579 generic.go:356] "Generic (PLEG): container finished" podID="232c873f-7a44-4e36-93ce-c6d1f6f5a855" containerID="1e43b0a6386a1b1b062985b65bd30101ea809736ad126038244f85b2483ab067" exitCode=1 Jun 13 02:01:16.845659 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.845562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"b1f2c31ae1f3e85b4a745dcd98a6c358be3a5843194bd0efdfecbc3de646e90c"} Jun 13 02:01:16.845659 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.845614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"0202ae690db13f0bfe3f70cd0b7053256af2f67289cc0be3394536842420c7ec"} Jun 13 02:01:16.845659 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.845651 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"e314ce1d55005d34b2d276c8474cf43ec38267d92287bb6ec44bd634c97f1398"} Jun 13 02:01:16.845797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.845685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerDied","Data":"1e43b0a6386a1b1b062985b65bd30101ea809736ad126038244f85b2483ab067"} Jun 13 02:01:16.845797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.845713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"59d10ffdeea3a1acdbc919e74515f9376de1c3de73a1e1e109d1f922926cc93f"} Jun 13 02:01:16.846608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.846572 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fgwvw" podStartSLOduration=4.379972173 podStartE2EDuration="22.846560684s" totalImagesPullingTime="18.466588511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:16.846125134 +0000 UTC m=+22.565341943" watchObservedRunningTime="2026-06-13 02:01:16.846560684 +0000 UTC m=+22.565777464" Jun 13 02:01:16.850647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.850626 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:01:16.851292 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.851275 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:01:16.863011 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.862959 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bqn6k" podStartSLOduration=4.385113895 podStartE2EDuration="22.862943162s" totalImagesPullingTime="18.477829267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:16.862267497 +0000 UTC m=+22.581484279" watchObservedRunningTime="2026-06-13 02:01:16.862943162 +0000 UTC m=+22.582159946" Jun 13 02:01:16.876272 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.876231 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-twdwh" podStartSLOduration=9.047073479 podStartE2EDuration="22.876219798s" totalImagesPullingTime="13.829146319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:16.87551991 +0000 UTC m=+22.594736692" watchObservedRunningTime="2026-06-13 02:01:16.876219798 +0000 UTC m=+22.595436579" Jun 13 02:01:16.890716 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.890671 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w5kcn" podStartSLOduration=4.4300104000000005 podStartE2EDuration="22.890653442s" totalImagesPullingTime="18.460643042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:16.890643676 +0000 UTC m=+22.609860496" watchObservedRunningTime="2026-06-13 02:01:16.890653442 +0000 UTC m=+22.609870237" Jun 13 02:01:16.907555 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:16.907480 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zfhx7" podStartSLOduration=4.437788958 podStartE2EDuration="22.907461364s" totalImagesPullingTime="18.469672406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:16.907438415 +0000 UTC m=+22.626655196" watchObservedRunningTime="2026-06-13 02:01:16.907461364 +0000 UTC m=+22.626678146" Jun 13 02:01:17.764982 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:17.764928 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 02:01:17.849523 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:17.849436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bp2w4" event={"ID":"53bcfa73-9c95-4822-94b2-5266d5979604","Type":"ContainerStarted","Data":"b84762aac9874c837ec1bb8134b507bc162b35acf47d282b317150c5cf3fb4c5"} Jun 13 02:01:17.851661 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:17.851633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" event={"ID":"d5444aae-da03-43ef-8c58-5d865c7afb50","Type":"ContainerStarted","Data":"543805c662a9cf6c77bdf5561e00d2324caef2b7ad21ef6dd1fa3276e6333982"} Jun 13 02:01:17.854795 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:17.854776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:01:17.855230 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:17.855203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"ab045926471dcb2b7075fdc2588eb845e4213d1ff62e21d687bf2d763ff203a5"} Jun 13 02:01:17.865031 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:17.864967 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bp2w4" podStartSLOduration=5.405833128 podStartE2EDuration="23.86495281s" totalImagesPullingTime="18.459119682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:17.864605924 +0000 UTC m=+23.583822724" watchObservedRunningTime="2026-06-13 02:01:17.86495281 +0000 UTC m=+23.584169591" Jun 13 02:01:18.692349 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:18.692310 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:18.692535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:18.692311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:18.692535 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:18.692434 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:18.692535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:18.692312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:18.692683 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:18.692500 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:18.692683 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:18.692611 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:18.700119 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:18.700031 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T02:01:17.764953761Z","UUID":"bbfe294f-ca5b-42a5-95b2-52e227ce931e","Handler":null,"Name":"","Endpoint":""} Jun 13 02:01:18.701647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:18.701618 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 02:01:18.701773 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:18.701673 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 02:01:18.857056 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:18.857030 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 02:01:19.862208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:19.861958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" event={"ID":"d5444aae-da03-43ef-8c58-5d865c7afb50","Type":"ContainerStarted","Data":"a48e8c0b501daafec53552652b4c66f9c716df946152b69fbcea849b98f5916f"} Jun 13 02:01:19.866391 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:19.866364 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:01:19.867217 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:19.867186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"533161326bf18f1ba6e611edc32dcccd7355ee23934ec129180bed7323ad0aa9"} Jun 13 02:01:19.882529 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:19.882487 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8dngb" podStartSLOduration=5.048340889 podStartE2EDuration="25.882468905s" totalImagesPullingTime="20.834128016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:19.88217763 +0000 UTC m=+25.601394432" watchObservedRunningTime="2026-06-13 02:01:19.882468905 +0000 UTC m=+25.601685688" Jun 13 02:01:20.693289 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:20.693253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:20.693477 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:20.693254 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:20.693477 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:20.693406 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:20.693568 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:20.693485 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:20.693568 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:20.693550 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:20.693647 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:20.693631 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:21.873368 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.873331 2579 generic.go:356] "Generic (PLEG): container finished" podID="753b8555-3e59-45a6-b8f4-46c97750e0ff" containerID="ed81ae53cc87ea22dd6815deac23b5ccb7bc523207443aa4aaa13c99b36b98b8" exitCode=0 Jun 13 02:01:21.874234 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.873412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerDied","Data":"ed81ae53cc87ea22dd6815deac23b5ccb7bc523207443aa4aaa13c99b36b98b8"} Jun 13 02:01:21.877094 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.876917 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:01:21.877454 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.877428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"4a6b2e41a52662d24b2c717a621ad10c067e777b08dd3bea462cff6314657e56"} Jun 13 02:01:21.877647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.877629 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:01:21.877753 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.877670 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:01:21.877884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.877869 2579 scope.go:117] "RemoveContainer" containerID="1e43b0a6386a1b1b062985b65bd30101ea809736ad126038244f85b2483ab067" Jun 13 02:01:21.893344 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:21.893325 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:01:22.692562 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.692529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:22.692667 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.692529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:22.692710 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.692660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:22.692710 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:22.692659 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:22.692804 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:22.692750 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:22.692849 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:22.692808 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:22.883049 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.882938 2579 generic.go:356] "Generic (PLEG): container finished" podID="753b8555-3e59-45a6-b8f4-46c97750e0ff" containerID="f4291fde9a2968e14ee25a064e0996b26e01857196da24bd7a9029c7a3ce1084" exitCode=0 Jun 13 02:01:22.883049 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.883026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerDied","Data":"f4291fde9a2968e14ee25a064e0996b26e01857196da24bd7a9029c7a3ce1084"} Jun 13 02:01:22.887910 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.887890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:01:22.888550 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.888526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" event={"ID":"232c873f-7a44-4e36-93ce-c6d1f6f5a855","Type":"ContainerStarted","Data":"67959475a4ac21ddfa38a5e2852b3a2d0971574c0d6c029b47eff20dfd0d905d"} Jun 13 02:01:22.889111 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.889013 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:01:22.904302 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.904277 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:01:22.931096 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:22.931052 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" podStartSLOduration=10.406045962 podStartE2EDuration="28.931037507s" totalImagesPullingTime="18.524991545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:22.930619252 +0000 UTC m=+28.649836056" watchObservedRunningTime="2026-06-13 02:01:22.931037507 +0000 UTC m=+28.650254287" Jun 13 02:01:23.081729 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.081697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4hxm"] Jun 13 02:01:23.081867 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.081790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:23.081916 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:23.081868 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:23.084749 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.084724 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vl5wj"] Jun 13 02:01:23.084849 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.084832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:23.084956 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:23.084938 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:23.085490 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.085466 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdz66"] Jun 13 02:01:23.085554 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.085545 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:23.085643 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:23.085623 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:23.893163 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.893075 2579 generic.go:356] "Generic (PLEG): container finished" podID="753b8555-3e59-45a6-b8f4-46c97750e0ff" containerID="23505d1f0d1474e9c4c11f114fff2beddfe122e4a7137bb512c10174eca830d8" exitCode=0 Jun 13 02:01:23.893561 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:23.893155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerDied","Data":"23505d1f0d1474e9c4c11f114fff2beddfe122e4a7137bb512c10174eca830d8"} Jun 13 02:01:24.693581 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:24.693543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:24.693746 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:24.693709 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:24.693843 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:24.693812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:24.693967 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:24.693943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:24.693967 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:24.693946 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:24.694160 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:24.694043 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:25.198535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:25.198504 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:01:25.198879 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:25.198662 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 13 02:01:25.199291 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:25.199274 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-twdwh" Jun 13 02:01:26.693330 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:26.693077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:26.693735 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:26.693105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:26.693735 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:26.693130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:26.693735 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:26.693509 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:26.693735 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:26.693445 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:26.693735 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:26.693563 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:28.408734 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.408707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:28.409179 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.408849 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:28.409179 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.408926 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:02:00.408904891 +0000 UTC m=+66.128121667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 02:01:28.509102 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.509073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:28.509235 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.509219 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:28.509295 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.509285 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret podName:b246934d-7e12-4daf-80d9-a50d13b681df nodeName:}" failed. No retries permitted until 2026-06-13 02:02:00.50926967 +0000 UTC m=+66.228486433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret") pod "global-pull-secret-syncer-s4hxm" (UID: "b246934d-7e12-4daf-80d9-a50d13b681df") : object "kube-system"/"original-pull-secret" not registered Jun 13 02:01:28.609983 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.609938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:28.610141 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.610093 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 02:01:28.610141 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.610119 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 02:01:28.610141 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.610132 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m4qk5 for pod openshift-network-diagnostics/network-check-target-bdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:28.610278 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.610199 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5 podName:d96410b2-61af-4eeb-a41e-bd47f6bc5fa3 nodeName:}" failed. No retries permitted until 2026-06-13 02:02:00.610179636 +0000 UTC m=+66.329396398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m4qk5" (UniqueName: "kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5") pod "network-check-target-bdz66" (UID: "d96410b2-61af-4eeb-a41e-bd47f6bc5fa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 02:01:28.692608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.692565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:28.692608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.692602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:28.692880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.692571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:28.692880 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.692669 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4hxm" podUID="b246934d-7e12-4daf-80d9-a50d13b681df" Jun 13 02:01:28.692880 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.692750 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdz66" podUID="d96410b2-61af-4eeb-a41e-bd47f6bc5fa3" Jun 13 02:01:28.692880 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:28.692827 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:01:28.909041 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.909008 2579 generic.go:356] "Generic (PLEG): container finished" podID="753b8555-3e59-45a6-b8f4-46c97750e0ff" containerID="39332d1df72cfb46054950a52b9c312c6c84f4ae6313a191dbbed31155e5c334" exitCode=0 Jun 13 02:01:28.909246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:28.909052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerDied","Data":"39332d1df72cfb46054950a52b9c312c6c84f4ae6313a191dbbed31155e5c334"} Jun 13 02:01:29.113353 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.113330 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-107.ec2.internal" event="NodeReady" Jun 13 02:01:29.113476 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.113443 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 02:01:29.159242 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.159209 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5nqt5"] Jun 13 02:01:29.169760 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.169734 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dkn7z"] Jun 13 02:01:29.169880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.169848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.173048 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.173023 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc58g\"" Jun 13 02:01:29.173181 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.173023 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 02:01:29.173181 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.173134 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 02:01:29.183043 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.182460 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkn7z"] Jun 13 02:01:29.183043 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.182510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nqt5"] Jun 13 02:01:29.183043 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.182623 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.186143 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.186122 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 02:01:29.186275 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.186140 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n4zgq\"" Jun 13 02:01:29.186275 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.186173 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 02:01:29.186464 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.186449 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 02:01:29.313765 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.313679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.313765 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.313725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrj69\" (UniqueName: \"kubernetes.io/projected/ffd37432-108b-4c57-9054-734f6e410e3e-kube-api-access-nrj69\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.313964 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.313778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffd37432-108b-4c57-9054-734f6e410e3e-config-volume\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.313964 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.313793 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm5w4\" (UniqueName: \"kubernetes.io/projected/f4ff27f7-358b-4260-a1f3-db51fb25c450-kube-api-access-wm5w4\") pod \"ingress-canary-dkn7z\" (UID: \"f4ff27f7-358b-4260-a1f3-db51fb25c450\") " pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.313964 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.313810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd37432-108b-4c57-9054-734f6e410e3e-tmp-dir\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.313964 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.313829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4ff27f7-358b-4260-a1f3-db51fb25c450-cert\") pod \"ingress-canary-dkn7z\" (UID: \"f4ff27f7-358b-4260-a1f3-db51fb25c450\") " pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.415041 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4ff27f7-358b-4260-a1f3-db51fb25c450-cert\") pod \"ingress-canary-dkn7z\" (UID: \"f4ff27f7-358b-4260-a1f3-db51fb25c450\") " pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrj69\" (UniqueName: \"kubernetes.io/projected/ffd37432-108b-4c57-9054-734f6e410e3e-kube-api-access-nrj69\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffd37432-108b-4c57-9054-734f6e410e3e-config-volume\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5w4\" (UniqueName: \"kubernetes.io/projected/f4ff27f7-358b-4260-a1f3-db51fb25c450-kube-api-access-wm5w4\") pod \"ingress-canary-dkn7z\" (UID: \"f4ff27f7-358b-4260-a1f3-db51fb25c450\") " pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd37432-108b-4c57-9054-734f6e410e3e-tmp-dir\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:29.415209 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:29.415277 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:29.915256181 +0000 UTC m=+35.634472960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:01:29.415702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415490 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffd37432-108b-4c57-9054-734f6e410e3e-tmp-dir\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.416051 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.415843 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffd37432-108b-4c57-9054-734f6e410e3e-config-volume\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.419094 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.419078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4ff27f7-358b-4260-a1f3-db51fb25c450-cert\") pod \"ingress-canary-dkn7z\" (UID: \"f4ff27f7-358b-4260-a1f3-db51fb25c450\") " pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.425708 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.425686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrj69\" (UniqueName: \"kubernetes.io/projected/ffd37432-108b-4c57-9054-734f6e410e3e-kube-api-access-nrj69\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.425870 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.425848 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm5w4\" (UniqueName: \"kubernetes.io/projected/f4ff27f7-358b-4260-a1f3-db51fb25c450-kube-api-access-wm5w4\") pod \"ingress-canary-dkn7z\" (UID: \"f4ff27f7-358b-4260-a1f3-db51fb25c450\") " pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.492918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.492876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dkn7z" Jun 13 02:01:29.669149 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.669107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dkn7z"] Jun 13 02:01:29.674713 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:01:29.674684 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ff27f7_358b_4260_a1f3_db51fb25c450.slice/crio-81d1c2cd77cb67fdcd708ca1ca9e800fdb3a7045424e73bed5a0ab53db6e452c WatchSource:0}: Error finding container 81d1c2cd77cb67fdcd708ca1ca9e800fdb3a7045424e73bed5a0ab53db6e452c: Status 404 returned error can't find the container with id 81d1c2cd77cb67fdcd708ca1ca9e800fdb3a7045424e73bed5a0ab53db6e452c Jun 13 02:01:29.914394 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.914366 2579 generic.go:356] "Generic (PLEG): container finished" podID="753b8555-3e59-45a6-b8f4-46c97750e0ff" containerID="d20e9514fc5ed10da9607f7099239009d8e15bcd0187aa56cb0e5290b2ab968d" exitCode=0 Jun 13 02:01:29.914631 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.914447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerDied","Data":"d20e9514fc5ed10da9607f7099239009d8e15bcd0187aa56cb0e5290b2ab968d"} Jun 13 02:01:29.915561 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.915533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkn7z" event={"ID":"f4ff27f7-358b-4260-a1f3-db51fb25c450","Type":"ContainerStarted","Data":"81d1c2cd77cb67fdcd708ca1ca9e800fdb3a7045424e73bed5a0ab53db6e452c"} Jun 13 02:01:29.919466 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:29.919447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:29.919604 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:29.919590 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:29.919671 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:29.919650 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:30.919631801 +0000 UTC m=+36.638848563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:01:30.692723 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.692688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:01:30.693406 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.692695 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:01:30.693406 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.692694 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:01:30.695505 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.695479 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xr6x\"" Jun 13 02:01:30.697081 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.697059 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 02:01:30.697261 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.697094 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 02:01:30.697261 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.697125 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 02:01:30.697261 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.697059 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sngzk\"" Jun 13 02:01:30.697438 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.697394 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 02:01:30.921772 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.921740 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv44v" event={"ID":"753b8555-3e59-45a6-b8f4-46c97750e0ff","Type":"ContainerStarted","Data":"8c5245336ad97adb2f53ef2ce85007eba45cf39f15a5bfc3547c84b3aebb67d4"} Jun 13 02:01:30.929328 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.929298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:30.929477 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:30.929421 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:30.929523 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:30.929480 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:32.929463037 +0000 UTC m=+38.648679802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:01:30.944188 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:30.944098 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dv44v" podStartSLOduration=8.427583094 podStartE2EDuration="36.944078525s" totalImagesPullingTime="28.516495431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:30.94244642 +0000 UTC m=+36.661663225" watchObservedRunningTime="2026-06-13 02:01:30.944078525 +0000 UTC m=+36.663295307" Jun 13 02:01:31.925943 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:31.925907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dkn7z" event={"ID":"f4ff27f7-358b-4260-a1f3-db51fb25c450","Type":"ContainerStarted","Data":"290257e3f654ad1839c8487f350faafd835b3086b06d02e92eef9fa4c3b5b482"} Jun 13 02:01:31.941514 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:31.941467 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dkn7z" podStartSLOduration=0.887131329 podStartE2EDuration="2.941453354s" totalImagesPullingTime="2.054322025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:01:31.940661696 +0000 UTC m=+37.659878501" watchObservedRunningTime="2026-06-13 02:01:31.941453354 +0000 UTC m=+37.660670134" Jun 13 02:01:32.947832 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:32.947635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:32.948222 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:32.947778 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:32.948222 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:32.947948 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:36.947931286 +0000 UTC m=+42.667148048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:01:36.975581 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:36.975541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:36.975958 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:36.975713 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:36.975958 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:36.975780 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:01:44.975760295 +0000 UTC m=+50.694977070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:01:45.030087 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:45.030043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:01:45.030552 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:45.030173 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:01:45.030552 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:01:45.030224 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:02:01.030210375 +0000 UTC m=+66.749427135 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:01:54.906632 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:01:54.906605 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gz2ss" Jun 13 02:02:00.432579 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.432537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:02:00.435686 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.435663 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 02:02:00.443059 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:02:00.443041 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 02:02:00.443157 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:02:00.443125 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:03:04.443102423 +0000 UTC m=+130.162319186 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : secret "metrics-daemon-secret" not found Jun 13 02:02:00.533765 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.533727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:02:00.536892 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.536871 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 02:02:00.548611 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.548580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b246934d-7e12-4daf-80d9-a50d13b681df-original-pull-secret\") pod \"global-pull-secret-syncer-s4hxm\" (UID: \"b246934d-7e12-4daf-80d9-a50d13b681df\") " pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:02:00.634286 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.634250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:02:00.637090 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.637074 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 02:02:00.647641 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.647626 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 02:02:00.658230 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.658207 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4qk5\" (UniqueName: \"kubernetes.io/projected/d96410b2-61af-4eeb-a41e-bd47f6bc5fa3-kube-api-access-m4qk5\") pod \"network-check-target-bdz66\" (UID: \"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3\") " pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:02:00.707561 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.707481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xr6x\"" Jun 13 02:02:00.710670 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.710642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4hxm" Jun 13 02:02:00.715774 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.715760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:02:00.886993 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.886947 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4hxm"] Jun 13 02:02:00.891667 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:02:00.891640 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb246934d_7e12_4daf_80d9_a50d13b681df.slice/crio-d65e594a128513903c1af072a4ccc31a988362973dc10fa7a9994e0fb4f84390 WatchSource:0}: Error finding container d65e594a128513903c1af072a4ccc31a988362973dc10fa7a9994e0fb4f84390: Status 404 returned error can't find the container with id d65e594a128513903c1af072a4ccc31a988362973dc10fa7a9994e0fb4f84390 Jun 13 02:02:00.899083 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.899063 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdz66"] Jun 13 02:02:00.901353 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:02:00.901323 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96410b2_61af_4eeb_a41e_bd47f6bc5fa3.slice/crio-01851447c7a567bd21db3c2768e3c76ba8982e09e5e62f8e09368aa99ac267cc WatchSource:0}: Error finding container 01851447c7a567bd21db3c2768e3c76ba8982e09e5e62f8e09368aa99ac267cc: Status 404 returned error can't find the container with id 01851447c7a567bd21db3c2768e3c76ba8982e09e5e62f8e09368aa99ac267cc Jun 13 02:02:00.994368 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.994276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdz66" event={"ID":"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3","Type":"ContainerStarted","Data":"01851447c7a567bd21db3c2768e3c76ba8982e09e5e62f8e09368aa99ac267cc"} Jun 13 02:02:00.995358 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:00.995335 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4hxm" event={"ID":"b246934d-7e12-4daf-80d9-a50d13b681df","Type":"ContainerStarted","Data":"d65e594a128513903c1af072a4ccc31a988362973dc10fa7a9994e0fb4f84390"} Jun 13 02:02:01.038123 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:01.038088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:02:01.038269 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:02:01.038230 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:02:01.038323 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:02:01.038294 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:02:33.038277727 +0000 UTC m=+98.757494486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:02:06.011280 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:06.011242 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdz66" event={"ID":"d96410b2-61af-4eeb-a41e-bd47f6bc5fa3","Type":"ContainerStarted","Data":"81c6c12ae341d9def1c4686e7d0ea339923167b1cc1010522081ef2709418602"} Jun 13 02:02:06.011793 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:06.011365 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:02:06.012698 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:06.012671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4hxm" event={"ID":"b246934d-7e12-4daf-80d9-a50d13b681df","Type":"ContainerStarted","Data":"05efbacb085cf13279f9d7911ab62b5268331aad11a5e42f326b791af282635f"} Jun 13 02:02:06.027251 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:06.027206 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bdz66" podStartSLOduration=67.33156538 podStartE2EDuration="1m12.0271908s" totalImagesPullingTime="4.69562542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:02:06.025808 +0000 UTC m=+71.745024796" watchObservedRunningTime="2026-06-13 02:02:06.0271908 +0000 UTC m=+71.746407579" Jun 13 02:02:06.040063 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:06.040018 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s4hxm" podStartSLOduration=67.329901659 podStartE2EDuration="1m12.040003836s" totalImagesPullingTime="4.710102177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:02:06.039967623 +0000 UTC m=+71.759184404" watchObservedRunningTime="2026-06-13 02:02:06.040003836 +0000 UTC m=+71.759220614" Jun 13 02:02:33.064880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:33.064826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:02:33.065329 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:02:33.064988 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:02:33.065329 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:02:33.065067 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:03:37.065051413 +0000 UTC m=+162.784268176 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:02:37.017550 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:02:37.017519 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bdz66" Jun 13 02:03:04.467672 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:03:04.467613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:03:04.468208 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:03:04.467786 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 02:03:04.468208 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:03:04.467858 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs podName:75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a nodeName:}" failed. No retries permitted until 2026-06-13 02:05:06.467840997 +0000 UTC m=+252.187057756 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs") pod "network-metrics-daemon-vl5wj" (UID: "75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a") : secret "metrics-daemon-secret" not found Jun 13 02:03:32.179090 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:03:32.179024 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5nqt5" podUID="ffd37432-108b-4c57-9054-734f6e410e3e" Jun 13 02:03:32.211858 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:03:32.211826 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nqt5" Jun 13 02:03:33.715615 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:03:33.715574 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vl5wj" podUID="75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a" Jun 13 02:03:37.086643 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:03:37.086556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:03:37.087024 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:03:37.086712 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 02:03:37.087024 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:03:37.086784 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls podName:ffd37432-108b-4c57-9054-734f6e410e3e nodeName:}" failed. No retries permitted until 2026-06-13 02:05:39.086768486 +0000 UTC m=+284.805985245 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls") pod "dns-default-5nqt5" (UID: "ffd37432-108b-4c57-9054-734f6e410e3e") : secret "dns-default-metrics-tls" not found Jun 13 02:03:47.693043 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:03:47.692999 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:04:30.719604 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.719569 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl"] Jun 13 02:04:30.721433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.721415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.723366 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.723343 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-h8tqk"] Jun 13 02:04:30.725336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.725320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.725608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.725586 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.726918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.726898 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 13 02:04:30.727035 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.726930 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wld8z\"" Jun 13 02:04:30.727035 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.726964 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.727150 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.727033 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 13 02:04:30.728050 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.728031 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-57ck2\"" Jun 13 02:04:30.728217 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.728198 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.729549 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.729527 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 13 02:04:30.729646 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.729580 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 13 02:04:30.731282 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.731266 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.734776 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.734756 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 13 02:04:30.735582 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.735560 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl"] Jun 13 02:04:30.738712 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.738693 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-h8tqk"] Jun 13 02:04:30.814113 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.814077 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-grbvr"] Jun 13 02:04:30.816096 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.816079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" Jun 13 02:04:30.818991 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.818953 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2mk4j\"" Jun 13 02:04:30.820497 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.820476 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj"] Jun 13 02:04:30.822246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.822226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:30.824285 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.824267 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-grbvr"] Jun 13 02:04:30.826474 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.826453 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 02:04:30.826633 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.826612 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 13 02:04:30.826728 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.826458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 13 02:04:30.826728 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.826487 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 02:04:30.826856 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.826567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vgltb\"" Jun 13 02:04:30.834915 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.834891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj"] Jun 13 02:04:30.836405 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.836383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9bmg\" (UniqueName: \"kubernetes.io/projected/e4b3675a-8285-46c0-9dac-769eaa957c6b-kube-api-access-q9bmg\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.836516 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.836412 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4b3675a-8285-46c0-9dac-769eaa957c6b-config\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.836516 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.836471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d851dde-c50a-4fa6-a2ad-55117976e969-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.836629 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.836550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d851dde-c50a-4fa6-a2ad-55117976e969-config\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.836629 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.836583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b3675a-8285-46c0-9dac-769eaa957c6b-serving-cert\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.836629 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.836610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4b3675a-8285-46c0-9dac-769eaa957c6b-trusted-ca\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.836758 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.836642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsdgm\" (UniqueName: \"kubernetes.io/projected/8d851dde-c50a-4fa6-a2ad-55117976e969-kube-api-access-rsdgm\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.937566 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dppvv\" (UniqueName: \"kubernetes.io/projected/0cd1160d-48b3-44a6-9471-d070ceb2af7f-kube-api-access-dppvv\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:30.937771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9bmg\" (UniqueName: \"kubernetes.io/projected/e4b3675a-8285-46c0-9dac-769eaa957c6b-kube-api-access-q9bmg\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.937771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4b3675a-8285-46c0-9dac-769eaa957c6b-config\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.937771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:30.937771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d851dde-c50a-4fa6-a2ad-55117976e969-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.937771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jthv7\" (UniqueName: \"kubernetes.io/projected/54b59809-c304-4473-abd6-691e419bded5-kube-api-access-jthv7\") pod \"network-check-source-6947749cfc-grbvr\" (UID: \"54b59809-c304-4473-abd6-691e419bded5\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" Jun 13 02:04:30.937771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0cd1160d-48b3-44a6-9471-d070ceb2af7f-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:30.938119 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d851dde-c50a-4fa6-a2ad-55117976e969-config\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.938119 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b3675a-8285-46c0-9dac-769eaa957c6b-serving-cert\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.938119 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4b3675a-8285-46c0-9dac-769eaa957c6b-trusted-ca\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.938119 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.937837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdgm\" (UniqueName: \"kubernetes.io/projected/8d851dde-c50a-4fa6-a2ad-55117976e969-kube-api-access-rsdgm\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.938510 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.938478 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d851dde-c50a-4fa6-a2ad-55117976e969-config\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.938638 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.938531 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4b3675a-8285-46c0-9dac-769eaa957c6b-config\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.938765 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.938745 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4b3675a-8285-46c0-9dac-769eaa957c6b-trusted-ca\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.940012 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.939989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d851dde-c50a-4fa6-a2ad-55117976e969-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.940148 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.940132 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b3675a-8285-46c0-9dac-769eaa957c6b-serving-cert\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:30.959406 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.959372 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsdgm\" (UniqueName: \"kubernetes.io/projected/8d851dde-c50a-4fa6-a2ad-55117976e969-kube-api-access-rsdgm\") pod \"service-ca-operator-7ccbfd59dc-g4dbl\" (UID: \"8d851dde-c50a-4fa6-a2ad-55117976e969\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:30.961063 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:30.961040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9bmg\" (UniqueName: \"kubernetes.io/projected/e4b3675a-8285-46c0-9dac-769eaa957c6b-kube-api-access-q9bmg\") pod \"console-operator-5dbbb5d744-h8tqk\" (UID: \"e4b3675a-8285-46c0-9dac-769eaa957c6b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:31.031323 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.031230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" Jun 13 02:04:31.037290 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.037261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:31.038583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.038546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:31.038672 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.038618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jthv7\" (UniqueName: \"kubernetes.io/projected/54b59809-c304-4473-abd6-691e419bded5-kube-api-access-jthv7\") pod \"network-check-source-6947749cfc-grbvr\" (UID: \"54b59809-c304-4473-abd6-691e419bded5\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" Jun 13 02:04:31.038672 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.038645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0cd1160d-48b3-44a6-9471-d070ceb2af7f-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:31.038771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.038688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dppvv\" (UniqueName: \"kubernetes.io/projected/0cd1160d-48b3-44a6-9471-d070ceb2af7f-kube-api-access-dppvv\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:31.038771 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:31.038703 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:31.038771 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:31.038768 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls podName:0cd1160d-48b3-44a6-9471-d070ceb2af7f nodeName:}" failed. No retries permitted until 2026-06-13 02:04:31.538748404 +0000 UTC m=+217.257965163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-287mj" (UID: "0cd1160d-48b3-44a6-9471-d070ceb2af7f") : secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:31.039445 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.039421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0cd1160d-48b3-44a6-9471-d070ceb2af7f-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:31.047366 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.047345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jthv7\" (UniqueName: \"kubernetes.io/projected/54b59809-c304-4473-abd6-691e419bded5-kube-api-access-jthv7\") pod \"network-check-source-6947749cfc-grbvr\" (UID: \"54b59809-c304-4473-abd6-691e419bded5\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" Jun 13 02:04:31.047366 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.047361 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dppvv\" (UniqueName: \"kubernetes.io/projected/0cd1160d-48b3-44a6-9471-d070ceb2af7f-kube-api-access-dppvv\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:31.125502 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.125469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" Jun 13 02:04:31.170685 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.170651 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl"] Jun 13 02:04:31.174340 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:31.174186 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d851dde_c50a_4fa6_a2ad_55117976e969.slice/crio-61630c0b243efde7093abae68a2895b333afa475e2808276f641fcdb95e7c517 WatchSource:0}: Error finding container 61630c0b243efde7093abae68a2895b333afa475e2808276f641fcdb95e7c517: Status 404 returned error can't find the container with id 61630c0b243efde7093abae68a2895b333afa475e2808276f641fcdb95e7c517 Jun 13 02:04:31.184678 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.184630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-h8tqk"] Jun 13 02:04:31.188657 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:31.188622 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b3675a_8285_46c0_9dac_769eaa957c6b.slice/crio-343e40ad5b24ae8a88f2718d4e988d9bf867cf88796cea63b43b82aced7b5a31 WatchSource:0}: Error finding container 343e40ad5b24ae8a88f2718d4e988d9bf867cf88796cea63b43b82aced7b5a31: Status 404 returned error can't find the container with id 343e40ad5b24ae8a88f2718d4e988d9bf867cf88796cea63b43b82aced7b5a31 Jun 13 02:04:31.251708 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.251674 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-grbvr"] Jun 13 02:04:31.254433 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:31.254397 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b59809_c304_4473_abd6_691e419bded5.slice/crio-5c619b08832c0e74162541ef8675fc4327a1dc3d7f3ac8a2dba0136d8f35af23 WatchSource:0}: Error finding container 5c619b08832c0e74162541ef8675fc4327a1dc3d7f3ac8a2dba0136d8f35af23: Status 404 returned error can't find the container with id 5c619b08832c0e74162541ef8675fc4327a1dc3d7f3ac8a2dba0136d8f35af23 Jun 13 02:04:31.345532 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.345494 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" event={"ID":"54b59809-c304-4473-abd6-691e419bded5","Type":"ContainerStarted","Data":"5d8aa772b259a43127261c8c64aa27bbf21e4ec7a988f4cdb3facf81432f9882"} Jun 13 02:04:31.345722 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.345570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" event={"ID":"54b59809-c304-4473-abd6-691e419bded5","Type":"ContainerStarted","Data":"5c619b08832c0e74162541ef8675fc4327a1dc3d7f3ac8a2dba0136d8f35af23"} Jun 13 02:04:31.346698 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.346671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" event={"ID":"e4b3675a-8285-46c0-9dac-769eaa957c6b","Type":"ContainerStarted","Data":"343e40ad5b24ae8a88f2718d4e988d9bf867cf88796cea63b43b82aced7b5a31"} Jun 13 02:04:31.347608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.347583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" event={"ID":"8d851dde-c50a-4fa6-a2ad-55117976e969","Type":"ContainerStarted","Data":"61630c0b243efde7093abae68a2895b333afa475e2808276f641fcdb95e7c517"} Jun 13 02:04:31.360443 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.360398 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-grbvr" podStartSLOduration=1.360384592 podStartE2EDuration="1.360384592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:31.359929908 +0000 UTC m=+217.079146721" watchObservedRunningTime="2026-06-13 02:04:31.360384592 +0000 UTC m=+217.079601373" Jun 13 02:04:31.542183 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:31.542087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:31.542340 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:31.542238 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:31.542340 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:31.542302 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls podName:0cd1160d-48b3-44a6-9471-d070ceb2af7f nodeName:}" failed. No retries permitted until 2026-06-13 02:04:32.542287272 +0000 UTC m=+218.261504030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-287mj" (UID: "0cd1160d-48b3-44a6-9471-d070ceb2af7f") : secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:32.550269 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:32.550220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:32.550756 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:32.550402 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:32.550756 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:32.550493 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls podName:0cd1160d-48b3-44a6-9471-d070ceb2af7f nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.550472244 +0000 UTC m=+220.269689006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-287mj" (UID: "0cd1160d-48b3-44a6-9471-d070ceb2af7f") : secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:33.355743 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:33.355703 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" event={"ID":"8d851dde-c50a-4fa6-a2ad-55117976e969","Type":"ContainerStarted","Data":"079467735ce05ed44b9aa37b6d52d2f764e00fb3c79a5c36c6d254b90dcf3d8c"} Jun 13 02:04:33.372256 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:33.372156 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" podStartSLOduration=1.4308658269999999 podStartE2EDuration="3.372139789s" totalImagesPullingTime="1.941273962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:33.370666467 +0000 UTC m=+219.089883267" watchObservedRunningTime="2026-06-13 02:04:33.372139789 +0000 UTC m=+219.091356580" Jun 13 02:04:34.287674 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.287639 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r6slw"] Jun 13 02:04:34.289865 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.289846 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.293726 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.293705 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 02:04:34.295077 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.295038 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6pdp8\"" Jun 13 02:04:34.295189 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.295079 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 02:04:34.295189 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.295081 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 02:04:34.295189 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.295100 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 02:04:34.303945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.303924 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6slw"] Jun 13 02:04:34.360918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.360895 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/0.log" Jun 13 02:04:34.361089 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.360931 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4b3675a-8285-46c0-9dac-769eaa957c6b" containerID="a18b96b74c24fb59ed51082df3f09bea42fe35f324079cbbbedfe6dfd752c332" exitCode=255 Jun 13 02:04:34.361089 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.360965 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" event={"ID":"e4b3675a-8285-46c0-9dac-769eaa957c6b","Type":"ContainerDied","Data":"a18b96b74c24fb59ed51082df3f09bea42fe35f324079cbbbedfe6dfd752c332"} Jun 13 02:04:34.361285 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.361269 2579 scope.go:117] "RemoveContainer" containerID="a18b96b74c24fb59ed51082df3f09bea42fe35f324079cbbbedfe6dfd752c332" Jun 13 02:04:34.361358 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.361307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-crio-socket\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.361358 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.361331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.361512 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.361369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpx9g\" (UniqueName: \"kubernetes.io/projected/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-api-access-cpx9g\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.361512 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.361426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.361512 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.361449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-data-volume\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.461937 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.461889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-crio-socket\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.461937 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.461942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.462203 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.462024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpx9g\" (UniqueName: \"kubernetes.io/projected/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-api-access-cpx9g\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.462203 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.462084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.462203 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.462122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-data-volume\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.462203 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.462142 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-crio-socket\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.462203 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.462085 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:34.462473 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.462245 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.962224701 +0000 UTC m=+220.681441477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : configmap "kube-rbac-proxy" not found Jun 13 02:04:34.462567 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.462540 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.462660 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.462645 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:34.96262895 +0000 UTC m=+220.681845727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.462660 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.462579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-data-volume\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.473535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.473501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpx9g\" (UniqueName: \"kubernetes.io/projected/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-api-access-cpx9g\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.562773 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.562688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:34.562910 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.562844 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:34.562959 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.562908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls podName:0cd1160d-48b3-44a6-9471-d070ceb2af7f nodeName:}" failed. No retries permitted until 2026-06-13 02:04:38.562890777 +0000 UTC m=+224.282107551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-287mj" (UID: "0cd1160d-48b3-44a6-9471-d070ceb2af7f") : secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:34.773483 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.773445 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9"] Jun 13 02:04:34.775386 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.775364 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" Jun 13 02:04:34.778152 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.778125 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 13 02:04:34.778272 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.778175 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9s2qt\"" Jun 13 02:04:34.778321 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.778273 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 13 02:04:34.783433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.783411 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9"] Jun 13 02:04:34.865425 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.865343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmm48\" (UniqueName: \"kubernetes.io/projected/144867f2-357f-47c0-978f-ae62e54ec1d2-kube-api-access-dmm48\") pod \"migrator-d4bcd4867-bjds9\" (UID: \"144867f2-357f-47c0-978f-ae62e54ec1d2\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" Jun 13 02:04:34.966710 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.966676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.966866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.966737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:34.966866 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.966761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmm48\" (UniqueName: \"kubernetes.io/projected/144867f2-357f-47c0-978f-ae62e54ec1d2-kube-api-access-dmm48\") pod \"migrator-d4bcd4867-bjds9\" (UID: \"144867f2-357f-47c0-978f-ae62e54ec1d2\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" Jun 13 02:04:34.966866 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.966833 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.966866 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.966860 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:34.967052 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.966898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:35.966883465 +0000 UTC m=+221.686100224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:34.967052 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:34.966915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:35.96690839 +0000 UTC m=+221.686125149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : configmap "kube-rbac-proxy" not found Jun 13 02:04:34.975928 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:34.975906 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmm48\" (UniqueName: \"kubernetes.io/projected/144867f2-357f-47c0-978f-ae62e54ec1d2-kube-api-access-dmm48\") pod \"migrator-d4bcd4867-bjds9\" (UID: \"144867f2-357f-47c0-978f-ae62e54ec1d2\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" Jun 13 02:04:35.084342 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.084314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" Jun 13 02:04:35.208663 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.208629 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9"] Jun 13 02:04:35.212513 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:35.212490 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144867f2_357f_47c0_978f_ae62e54ec1d2.slice/crio-07802c8af525f6ba8f2dbdb8d18dc047446c4a1f125995fcb7b7da0a18aac150 WatchSource:0}: Error finding container 07802c8af525f6ba8f2dbdb8d18dc047446c4a1f125995fcb7b7da0a18aac150: Status 404 returned error can't find the container with id 07802c8af525f6ba8f2dbdb8d18dc047446c4a1f125995fcb7b7da0a18aac150 Jun 13 02:04:35.365331 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.365299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" event={"ID":"144867f2-357f-47c0-978f-ae62e54ec1d2","Type":"ContainerStarted","Data":"07802c8af525f6ba8f2dbdb8d18dc047446c4a1f125995fcb7b7da0a18aac150"} Jun 13 02:04:35.366724 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.366707 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/1.log" Jun 13 02:04:35.367111 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.367095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/0.log" Jun 13 02:04:35.367178 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.367129 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4b3675a-8285-46c0-9dac-769eaa957c6b" containerID="42aa25ce95eeaf70bf08c9835436a01ca31a3af4c1c72f1f1c8fc256f8a8a68c" exitCode=255 Jun 13 02:04:35.367178 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.367158 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" event={"ID":"e4b3675a-8285-46c0-9dac-769eaa957c6b","Type":"ContainerDied","Data":"42aa25ce95eeaf70bf08c9835436a01ca31a3af4c1c72f1f1c8fc256f8a8a68c"} Jun 13 02:04:35.367256 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.367200 2579 scope.go:117] "RemoveContainer" containerID="a18b96b74c24fb59ed51082df3f09bea42fe35f324079cbbbedfe6dfd752c332" Jun 13 02:04:35.367438 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.367425 2579 scope.go:117] "RemoveContainer" containerID="42aa25ce95eeaf70bf08c9835436a01ca31a3af4c1c72f1f1c8fc256f8a8a68c" Jun 13 02:04:35.367624 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:35.367605 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-h8tqk_openshift-console-operator(e4b3675a-8285-46c0-9dac-769eaa957c6b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" podUID="e4b3675a-8285-46c0-9dac-769eaa957c6b" Jun 13 02:04:35.975476 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.975438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:35.975749 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:35.975530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:35.975749 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:35.975581 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:35.975749 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:35.975615 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:35.975749 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:35.975654 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:37.97563288 +0000 UTC m=+223.694849657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:35.975749 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:35.975672 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:37.975665301 +0000 UTC m=+223.694882060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : configmap "kube-rbac-proxy" not found Jun 13 02:04:36.268639 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:36.268561 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fgwvw_b4f4d864-e019-4901-8bb1-950b3602add4/dns-node-resolver/0.log" Jun 13 02:04:36.371574 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:36.371550 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/1.log" Jun 13 02:04:36.371993 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:36.371929 2579 scope.go:117] "RemoveContainer" containerID="42aa25ce95eeaf70bf08c9835436a01ca31a3af4c1c72f1f1c8fc256f8a8a68c" Jun 13 02:04:36.372146 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:36.372123 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-h8tqk_openshift-console-operator(e4b3675a-8285-46c0-9dac-769eaa957c6b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" podUID="e4b3675a-8285-46c0-9dac-769eaa957c6b" Jun 13 02:04:37.290417 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.290384 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-259gg"] Jun 13 02:04:37.293481 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.293460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.296296 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.296275 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 13 02:04:37.297651 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.297634 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 13 02:04:37.297651 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.297642 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vmx49\"" Jun 13 02:04:37.297792 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.297642 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 13 02:04:37.297792 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.297632 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 13 02:04:37.300593 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.300571 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-259gg"] Jun 13 02:04:37.376521 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.376488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" event={"ID":"144867f2-357f-47c0-978f-ae62e54ec1d2","Type":"ContainerStarted","Data":"afe3961ab09c468dcf7e75401f113eba7987fe9d4ba7d7360c89d496732e4847"} Jun 13 02:04:37.376889 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.376539 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" event={"ID":"144867f2-357f-47c0-978f-ae62e54ec1d2","Type":"ContainerStarted","Data":"c0a56a5a1dcb7d31bd6434870e7fda3d97a2745d0b924a0fbe6d3a5d2d4938d1"} Jun 13 02:04:37.388054 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.388031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d86f2cb0-c108-493b-9f34-e286d6b5e587-signing-key\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.388140 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.388125 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d86f2cb0-c108-493b-9f34-e286d6b5e587-signing-cabundle\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.388181 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.388153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd27g\" (UniqueName: \"kubernetes.io/projected/d86f2cb0-c108-493b-9f34-e286d6b5e587-kube-api-access-dd27g\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.392065 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.392025 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bjds9" podStartSLOduration=2.229141246 podStartE2EDuration="3.392009961s" totalImagesPullingTime="1.162868715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:37.391820061 +0000 UTC m=+223.111036863" watchObservedRunningTime="2026-06-13 02:04:37.392009961 +0000 UTC m=+223.111226782" Jun 13 02:04:37.468401 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.468373 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5kcn_cbe49d38-3643-4ad0-b4ef-951aa7985161/node-ca/0.log" Jun 13 02:04:37.488720 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.488694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d86f2cb0-c108-493b-9f34-e286d6b5e587-signing-cabundle\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.488795 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.488727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd27g\" (UniqueName: \"kubernetes.io/projected/d86f2cb0-c108-493b-9f34-e286d6b5e587-kube-api-access-dd27g\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.488795 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.488785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d86f2cb0-c108-493b-9f34-e286d6b5e587-signing-key\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.489383 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.489358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d86f2cb0-c108-493b-9f34-e286d6b5e587-signing-cabundle\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.491197 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.491179 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d86f2cb0-c108-493b-9f34-e286d6b5e587-signing-key\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.497084 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.497062 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd27g\" (UniqueName: \"kubernetes.io/projected/d86f2cb0-c108-493b-9f34-e286d6b5e587-kube-api-access-dd27g\") pod \"service-ca-7b994bc59-259gg\" (UID: \"d86f2cb0-c108-493b-9f34-e286d6b5e587\") " pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.602564 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.602480 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-259gg" Jun 13 02:04:37.725822 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.725786 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-259gg"] Jun 13 02:04:37.728691 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:37.728668 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86f2cb0_c108_493b_9f34_e286d6b5e587.slice/crio-c66e30efda354f123744b777a741f66b0a0920e31c89feedf6157af4a4cfb03b WatchSource:0}: Error finding container c66e30efda354f123744b777a741f66b0a0920e31c89feedf6157af4a4cfb03b: Status 404 returned error can't find the container with id c66e30efda354f123744b777a741f66b0a0920e31c89feedf6157af4a4cfb03b Jun 13 02:04:37.993697 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.993650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:37.993871 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:37.993745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:37.993871 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:37.993834 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:37.993871 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:37.993837 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:37.994052 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:37.993898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:41.993879653 +0000 UTC m=+227.713096419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : configmap "kube-rbac-proxy" not found Jun 13 02:04:37.994052 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:37.993916 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:41.993907086 +0000 UTC m=+227.713123849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:38.069151 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:38.069121 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkn7z_f4ff27f7-358b-4260-a1f3-db51fb25c450/serve-healthcheck-canary/0.log" Jun 13 02:04:38.383352 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:38.383268 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-259gg" event={"ID":"d86f2cb0-c108-493b-9f34-e286d6b5e587","Type":"ContainerStarted","Data":"f23a4dc929db735758909e6bd8c769eb6bc01084de718df8ef69c282b1d6ea2a"} Jun 13 02:04:38.383352 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:38.383346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-259gg" event={"ID":"d86f2cb0-c108-493b-9f34-e286d6b5e587","Type":"ContainerStarted","Data":"c66e30efda354f123744b777a741f66b0a0920e31c89feedf6157af4a4cfb03b"} Jun 13 02:04:38.401008 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:38.400942 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-259gg" podStartSLOduration=1.400926975 podStartE2EDuration="1.400926975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:38.400283729 +0000 UTC m=+224.119500531" watchObservedRunningTime="2026-06-13 02:04:38.400926975 +0000 UTC m=+224.120143803" Jun 13 02:04:38.598322 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:38.598282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:38.598497 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:38.598434 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:38.598497 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:38.598494 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls podName:0cd1160d-48b3-44a6-9471-d070ceb2af7f nodeName:}" failed. No retries permitted until 2026-06-13 02:04:46.598477013 +0000 UTC m=+232.317693776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-287mj" (UID: "0cd1160d-48b3-44a6-9471-d070ceb2af7f") : secret "cluster-monitoring-operator-tls" not found Jun 13 02:04:41.038263 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:41.038223 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:41.038648 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:41.038284 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:04:41.038648 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:41.038600 2579 scope.go:117] "RemoveContainer" containerID="42aa25ce95eeaf70bf08c9835436a01ca31a3af4c1c72f1f1c8fc256f8a8a68c" Jun 13 02:04:41.038746 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:41.038728 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-h8tqk_openshift-console-operator(e4b3675a-8285-46c0-9dac-769eaa957c6b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" podUID="e4b3675a-8285-46c0-9dac-769eaa957c6b" Jun 13 02:04:42.025377 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:42.025324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:42.025605 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:42.025439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:42.025605 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:42.025448 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 02:04:42.025605 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:42.025515 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:50.025498009 +0000 UTC m=+235.744714787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : configmap "kube-rbac-proxy" not found Jun 13 02:04:42.025605 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:42.025560 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 02:04:42.025769 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:42.025615 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls podName:f18a5afc-e14b-4e35-b4b8-4d690bff4c93 nodeName:}" failed. No retries permitted until 2026-06-13 02:04:50.025599464 +0000 UTC m=+235.744816226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6slw" (UID: "f18a5afc-e14b-4e35-b4b8-4d690bff4c93") : secret "insights-runtime-extractor-tls" not found Jun 13 02:04:46.658209 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:46.658165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:46.660601 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:46.660575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cd1160d-48b3-44a6-9471-d070ceb2af7f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-287mj\" (UID: \"0cd1160d-48b3-44a6-9471-d070ceb2af7f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:46.731919 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:46.731883 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" Jun 13 02:04:46.856560 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:46.856454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj"] Jun 13 02:04:46.859015 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:46.858984 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd1160d_48b3_44a6_9471_d070ceb2af7f.slice/crio-e292ad3531cce8acd3a24d6e23d27689a5ee31e94456338554cf9e06b2d97051 WatchSource:0}: Error finding container e292ad3531cce8acd3a24d6e23d27689a5ee31e94456338554cf9e06b2d97051: Status 404 returned error can't find the container with id e292ad3531cce8acd3a24d6e23d27689a5ee31e94456338554cf9e06b2d97051 Jun 13 02:04:47.413404 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:47.413363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" event={"ID":"0cd1160d-48b3-44a6-9471-d070ceb2af7f","Type":"ContainerStarted","Data":"e292ad3531cce8acd3a24d6e23d27689a5ee31e94456338554cf9e06b2d97051"} Jun 13 02:04:49.421883 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:49.421848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" event={"ID":"0cd1160d-48b3-44a6-9471-d070ceb2af7f","Type":"ContainerStarted","Data":"c97a70a5022129b39df1d14520b6aee953a122e54bd9732833a8774f6cddf6ba"} Jun 13 02:04:49.437083 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:49.437028 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-287mj" podStartSLOduration=17.657927237 podStartE2EDuration="19.437010951s" totalImagesPullingTime="1.779083714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:49.436438697 +0000 UTC m=+235.155655520" watchObservedRunningTime="2026-06-13 02:04:49.437010951 +0000 UTC m=+235.156227732" Jun 13 02:04:50.084881 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:50.084844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:50.085098 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:50.084920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:50.085413 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:50.085393 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:50.087215 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:50.087192 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f18a5afc-e14b-4e35-b4b8-4d690bff4c93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6slw\" (UID: \"f18a5afc-e14b-4e35-b4b8-4d690bff4c93\") " pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:50.198646 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:50.198608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6slw" Jun 13 02:04:50.326382 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:50.326339 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6slw"] Jun 13 02:04:50.328766 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:50.328736 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18a5afc_e14b_4e35_b4b8_4d690bff4c93.slice/crio-b3cf4240bf9fe175dd4660d3a225add654d4645652a4695bcc7e1de5ac34acd4 WatchSource:0}: Error finding container b3cf4240bf9fe175dd4660d3a225add654d4645652a4695bcc7e1de5ac34acd4: Status 404 returned error can't find the container with id b3cf4240bf9fe175dd4660d3a225add654d4645652a4695bcc7e1de5ac34acd4 Jun 13 02:04:50.425943 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:50.425905 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6slw" event={"ID":"f18a5afc-e14b-4e35-b4b8-4d690bff4c93","Type":"ContainerStarted","Data":"b3cf4240bf9fe175dd4660d3a225add654d4645652a4695bcc7e1de5ac34acd4"} Jun 13 02:04:54.445943 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:54.445911 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6slw" event={"ID":"f18a5afc-e14b-4e35-b4b8-4d690bff4c93","Type":"ContainerStarted","Data":"500e9cc31e2047bec89a93a3f86b87e201da21e91cf1a599b1632d5aa36e704b"} Jun 13 02:04:54.446278 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:54.445966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6slw" event={"ID":"f18a5afc-e14b-4e35-b4b8-4d690bff4c93","Type":"ContainerStarted","Data":"8d6146830cadb5700df8062c638c3053d8dbe45e2e8ebb8cf4cc80b1a6b8ee05"} Jun 13 02:04:54.694212 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:54.694186 2579 scope.go:117] "RemoveContainer" containerID="42aa25ce95eeaf70bf08c9835436a01ca31a3af4c1c72f1f1c8fc256f8a8a68c" Jun 13 02:04:55.455773 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:55.455734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:04:55.456243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:55.456175 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/1.log" Jun 13 02:04:55.456243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:55.456216 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4b3675a-8285-46c0-9dac-769eaa957c6b" containerID="c7e314ceb318e6e7cdc574dc802033394b63a05f816c11afad424eb224db805c" exitCode=255 Jun 13 02:04:55.456342 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:55.456297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" event={"ID":"e4b3675a-8285-46c0-9dac-769eaa957c6b","Type":"ContainerDied","Data":"c7e314ceb318e6e7cdc574dc802033394b63a05f816c11afad424eb224db805c"} Jun 13 02:04:55.456402 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:55.456377 2579 scope.go:117] "RemoveContainer" containerID="42aa25ce95eeaf70bf08c9835436a01ca31a3af4c1c72f1f1c8fc256f8a8a68c" Jun 13 02:04:55.456702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:55.456682 2579 scope.go:117] "RemoveContainer" containerID="c7e314ceb318e6e7cdc574dc802033394b63a05f816c11afad424eb224db805c" Jun 13 02:04:55.456894 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:04:55.456872 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-h8tqk_openshift-console-operator(e4b3675a-8285-46c0-9dac-769eaa957c6b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" podUID="e4b3675a-8285-46c0-9dac-769eaa957c6b" Jun 13 02:04:56.461674 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:56.461640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6slw" event={"ID":"f18a5afc-e14b-4e35-b4b8-4d690bff4c93","Type":"ContainerStarted","Data":"f55022fd4e205dc831dcf3a3818d78494d255adb303f849fbd96b2e753d911c6"} Jun 13 02:04:56.463087 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:56.463067 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:04:56.480328 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:56.480291 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r6slw" podStartSLOduration=16.898365276 podStartE2EDuration="22.480278974s" totalImagesPullingTime="5.581913698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:04:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:56.47980493 +0000 UTC m=+242.199021735" watchObservedRunningTime="2026-06-13 02:04:56.480278974 +0000 UTC m=+242.199495755" Jun 13 02:04:58.821936 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.821898 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85956c6647-npmm6"] Jun 13 02:04:58.826667 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.826637 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.830198 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.830165 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 02:04:58.830336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.830241 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 02:04:58.832198 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.832175 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x269m\"" Jun 13 02:04:58.832513 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.832488 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 02:04:58.838636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.838613 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 02:04:58.839763 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.839744 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85956c6647-npmm6"] Jun 13 02:04:58.953162 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnzf9\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-kube-api-access-gnzf9\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.953304 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-ca-trust-extracted\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.953304 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-registry-certificates\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.953398 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-image-registry-private-configuration\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.953398 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-bound-sa-token\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.953398 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-registry-tls\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.953398 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-installation-pull-secrets\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:58.953518 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:58.953431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-trusted-ca\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.053880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.053854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-ca-trust-extracted\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.053880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.053884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-registry-certificates\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.053911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-image-registry-private-configuration\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.053947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-bound-sa-token\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.053996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-registry-tls\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.054023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-installation-pull-secrets\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.054057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-trusted-ca\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.054085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnzf9\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-kube-api-access-gnzf9\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054492 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.054400 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-ca-trust-extracted\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.054881 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.054851 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-registry-certificates\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.055131 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.055109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-trusted-ca\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.056501 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.056478 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-installation-pull-secrets\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.056587 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.056542 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-registry-tls\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.056587 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.056578 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-image-registry-private-configuration\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.061511 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.061489 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-bound-sa-token\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.061772 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.061756 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnzf9\" (UniqueName: \"kubernetes.io/projected/6e52dd83-00e2-4e84-9ee6-e27b578d1ef1-kube-api-access-gnzf9\") pod \"image-registry-85956c6647-npmm6\" (UID: \"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1\") " pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.136186 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.136097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.268687 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.268661 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85956c6647-npmm6"] Jun 13 02:04:59.273164 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:04:59.273130 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e52dd83_00e2_4e84_9ee6_e27b578d1ef1.slice/crio-fb4615f4d68e738ff504135cfa0713678b62b97e7e69658ca1f0e14bad37d8a8 WatchSource:0}: Error finding container fb4615f4d68e738ff504135cfa0713678b62b97e7e69658ca1f0e14bad37d8a8: Status 404 returned error can't find the container with id fb4615f4d68e738ff504135cfa0713678b62b97e7e69658ca1f0e14bad37d8a8 Jun 13 02:04:59.475952 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.475915 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85956c6647-npmm6" event={"ID":"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1","Type":"ContainerStarted","Data":"f06e19088b9c93671474380ff3cb613c837a37d90ff99b8859e0e9dea8cc9d38"} Jun 13 02:04:59.476135 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.475987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85956c6647-npmm6" event={"ID":"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1","Type":"ContainerStarted","Data":"fb4615f4d68e738ff504135cfa0713678b62b97e7e69658ca1f0e14bad37d8a8"} Jun 13 02:04:59.476135 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.476012 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:04:59.494293 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:04:59.494237 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podStartSLOduration=1.494222876 podStartE2EDuration="1.494222876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:04:59.493528802 +0000 UTC m=+245.212745598" watchObservedRunningTime="2026-06-13 02:04:59.494222876 +0000 UTC m=+245.213439656" Jun 13 02:05:01.038165 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.038132 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:05:01.038608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.038185 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:05:01.038608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.038484 2579 scope.go:117] "RemoveContainer" containerID="c7e314ceb318e6e7cdc574dc802033394b63a05f816c11afad424eb224db805c" Jun 13 02:05:01.038681 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:05:01.038623 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-h8tqk_openshift-console-operator(e4b3675a-8285-46c0-9dac-769eaa957c6b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" podUID="e4b3675a-8285-46c0-9dac-769eaa957c6b" Jun 13 02:05:01.142727 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.142692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr"] Jun 13 02:05:01.147421 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.147401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.150239 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.150207 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 13 02:05:01.150394 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.150374 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vf85n\"" Jun 13 02:05:01.150512 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.150494 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 02:05:01.150657 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.150546 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 13 02:05:01.155780 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.155653 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr"] Jun 13 02:05:01.272945 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.272898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d7w7\" (UniqueName: \"kubernetes.io/projected/70661726-4073-4046-8487-4fac68c94a68-kube-api-access-7d7w7\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.273144 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.272963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.273144 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.273013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70661726-4073-4046-8487-4fac68c94a68-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.273144 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.273069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.373896 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.373797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.373896 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.373880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d7w7\" (UniqueName: \"kubernetes.io/projected/70661726-4073-4046-8487-4fac68c94a68-kube-api-access-7d7w7\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.374136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.373925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.374136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.373953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70661726-4073-4046-8487-4fac68c94a68-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.374136 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:05:01.374048 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 13 02:05:01.374136 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:05:01.374120 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-tls podName:70661726-4073-4046-8487-4fac68c94a68 nodeName:}" failed. No retries permitted until 2026-06-13 02:05:01.874099533 +0000 UTC m=+247.593316307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-b6nzr" (UID: "70661726-4073-4046-8487-4fac68c94a68") : secret "prometheus-operator-tls" not found Jun 13 02:05:01.374659 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.374633 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70661726-4073-4046-8487-4fac68c94a68-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.376331 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.376309 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.384749 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.384718 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d7w7\" (UniqueName: \"kubernetes.io/projected/70661726-4073-4046-8487-4fac68c94a68-kube-api-access-7d7w7\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.877234 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.877186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:01.879629 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:01.879601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/70661726-4073-4046-8487-4fac68c94a68-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-b6nzr\" (UID: \"70661726-4073-4046-8487-4fac68c94a68\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:02.059433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:02.059392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" Jun 13 02:05:02.184261 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:02.184107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr"] Jun 13 02:05:02.186547 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:02.186522 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70661726_4073_4046_8487_4fac68c94a68.slice/crio-254df697a4ac734b13539b34b015a109a739b69cb630d7bec561f1a004659c8a WatchSource:0}: Error finding container 254df697a4ac734b13539b34b015a109a739b69cb630d7bec561f1a004659c8a: Status 404 returned error can't find the container with id 254df697a4ac734b13539b34b015a109a739b69cb630d7bec561f1a004659c8a Jun 13 02:05:02.488850 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:02.488817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" event={"ID":"70661726-4073-4046-8487-4fac68c94a68","Type":"ContainerStarted","Data":"254df697a4ac734b13539b34b015a109a739b69cb630d7bec561f1a004659c8a"} Jun 13 02:05:04.497695 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:04.497659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" event={"ID":"70661726-4073-4046-8487-4fac68c94a68","Type":"ContainerStarted","Data":"56774c1e5a047bf3f06e2ab40fc0b33b2decbbe45e94c129cd70ba7329cf1b82"} Jun 13 02:05:04.498061 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:04.497716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" event={"ID":"70661726-4073-4046-8487-4fac68c94a68","Type":"ContainerStarted","Data":"110c60c41c62c51cfa01d96aa13a2feec4e5fff11618ded6a6f0853bf9b482cd"} Jun 13 02:05:04.514260 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:04.514214 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-b6nzr" podStartSLOduration=2.171665748 podStartE2EDuration="3.514199215s" totalImagesPullingTime="1.342533467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:04.512799208 +0000 UTC m=+250.232016015" watchObservedRunningTime="2026-06-13 02:05:04.514199215 +0000 UTC m=+250.233415995" Jun 13 02:05:06.477037 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.476936 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bkbp4"] Jun 13 02:05:06.480132 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.480109 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.482715 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.482687 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 02:05:06.482921 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.482891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rj66z\"" Jun 13 02:05:06.483047 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.482934 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 02:05:06.483270 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.483254 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 02:05:06.513021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.512984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:05:06.515451 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.515427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a-metrics-certs\") pod \"network-metrics-daemon-vl5wj\" (UID: \"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a\") " pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:05:06.596901 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.596866 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sngzk\"" Jun 13 02:05:06.605111 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.605083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vl5wj" Jun 13 02:05:06.614309 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-wtmp\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-root\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l27xj\" (UniqueName: \"kubernetes.io/projected/46a3b27f-0763-4000-a79a-52d1a4ebf406-kube-api-access-l27xj\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-tls\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614588 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-textfile\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614588 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614588 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614588 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a3b27f-0763-4000-a79a-52d1a4ebf406-metrics-client-ca\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.614588 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.614548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-sys\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715059 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-wtmp\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715210 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-root\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715210 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l27xj\" (UniqueName: \"kubernetes.io/projected/46a3b27f-0763-4000-a79a-52d1a4ebf406-kube-api-access-l27xj\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715210 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-tls\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715210 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-textfile\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715210 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715485 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715485 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715241 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-wtmp\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715485 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a3b27f-0763-4000-a79a-52d1a4ebf406-metrics-client-ca\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715485 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-sys\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715485 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-sys\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715854 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46a3b27f-0763-4000-a79a-52d1a4ebf406-metrics-client-ca\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.715854 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46a3b27f-0763-4000-a79a-52d1a4ebf406-root\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.716100 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.715981 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-textfile\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.716159 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.716127 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-accelerators-collector-config\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.718272 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.718231 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.718499 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.718482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46a3b27f-0763-4000-a79a-52d1a4ebf406-node-exporter-tls\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.723779 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.723748 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l27xj\" (UniqueName: \"kubernetes.io/projected/46a3b27f-0763-4000-a79a-52d1a4ebf406-kube-api-access-l27xj\") pod \"node-exporter-bkbp4\" (UID: \"46a3b27f-0763-4000-a79a-52d1a4ebf406\") " pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.742861 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.742820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vl5wj"] Jun 13 02:05:06.745453 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:06.745430 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75840bbc_4e78_4b3a_bc97_3ac4e5fa5e2a.slice/crio-2044aa68ef9d6594260cd4965759e79a82c2f199d19fd53b2a3b1208c9306330 WatchSource:0}: Error finding container 2044aa68ef9d6594260cd4965759e79a82c2f199d19fd53b2a3b1208c9306330: Status 404 returned error can't find the container with id 2044aa68ef9d6594260cd4965759e79a82c2f199d19fd53b2a3b1208c9306330 Jun 13 02:05:06.789496 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:06.789458 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bkbp4" Jun 13 02:05:06.803510 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:06.803483 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a3b27f_0763_4000_a79a_52d1a4ebf406.slice/crio-2101dea577ec00d06cb0815ba3ba216af8cae45e1af39dcc8f5cad2e913f0bc7 WatchSource:0}: Error finding container 2101dea577ec00d06cb0815ba3ba216af8cae45e1af39dcc8f5cad2e913f0bc7: Status 404 returned error can't find the container with id 2101dea577ec00d06cb0815ba3ba216af8cae45e1af39dcc8f5cad2e913f0bc7 Jun 13 02:05:07.512430 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:07.512206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkbp4" event={"ID":"46a3b27f-0763-4000-a79a-52d1a4ebf406","Type":"ContainerStarted","Data":"2101dea577ec00d06cb0815ba3ba216af8cae45e1af39dcc8f5cad2e913f0bc7"} Jun 13 02:05:07.514215 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:07.514156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vl5wj" event={"ID":"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a","Type":"ContainerStarted","Data":"2044aa68ef9d6594260cd4965759e79a82c2f199d19fd53b2a3b1208c9306330"} Jun 13 02:05:08.518899 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:08.518863 2579 generic.go:356] "Generic (PLEG): container finished" podID="46a3b27f-0763-4000-a79a-52d1a4ebf406" containerID="bf71cb3e887df707f3545797df3d8e4470712839c80c81cdc273a198c05999cc" exitCode=0 Jun 13 02:05:08.519357 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:08.518957 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkbp4" event={"ID":"46a3b27f-0763-4000-a79a-52d1a4ebf406","Type":"ContainerDied","Data":"bf71cb3e887df707f3545797df3d8e4470712839c80c81cdc273a198c05999cc"} Jun 13 02:05:08.520742 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:08.520721 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vl5wj" event={"ID":"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a","Type":"ContainerStarted","Data":"b6be11e79255cc4728bcdae187d1b78d64478f2baf22086ea891b1c49dc7333c"} Jun 13 02:05:08.520844 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:08.520769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vl5wj" event={"ID":"75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a","Type":"ContainerStarted","Data":"f61ac589917ae8c40dffab22960bbd7bab53d59c8115a4ec5cc286a8af6fc4b9"} Jun 13 02:05:08.553588 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:08.553539 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vl5wj" podStartSLOduration=253.177362915 podStartE2EDuration="4m14.553523813s" totalImagesPullingTime="1.376160898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:08.55268754 +0000 UTC m=+254.271904349" watchObservedRunningTime="2026-06-13 02:05:08.553523813 +0000 UTC m=+254.272740595" Jun 13 02:05:09.443853 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.443821 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-99d95bdb5-zk785"] Jun 13 02:05:09.447531 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.447509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.450513 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.450487 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 13 02:05:09.450617 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.450498 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 13 02:05:09.450834 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.450821 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 13 02:05:09.450899 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.450824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dmv59gbtcno6p\"" Jun 13 02:05:09.450899 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.450853 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 13 02:05:09.451724 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.451705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 13 02:05:09.451800 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.451714 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tmkdg\"" Jun 13 02:05:09.458771 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.458751 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99d95bdb5-zk785"] Jun 13 02:05:09.527024 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.526986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkbp4" event={"ID":"46a3b27f-0763-4000-a79a-52d1a4ebf406","Type":"ContainerStarted","Data":"d7e05467cf6fe5bd419053181058e6fd59b019c5a1b375aea9efc16ac44e0817"} Jun 13 02:05:09.527486 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.527053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bkbp4" event={"ID":"46a3b27f-0763-4000-a79a-52d1a4ebf406","Type":"ContainerStarted","Data":"309cc18b5108fd372ec5605c36f94048fd55f01bf49b57b987f2e6818b172d7c"} Jun 13 02:05:09.546938 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.546892 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bkbp4" podStartSLOduration=2.145159773 podStartE2EDuration="3.546876428s" totalImagesPullingTime="1.319093788s" totalInitContainerRuntime="82.622867ms" isStatefulPod=true podCreationTimestamp="2026-06-13 02:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:09.546037178 +0000 UTC m=+255.265253980" watchObservedRunningTime="2026-06-13 02:05:09.546876428 +0000 UTC m=+255.266093209" Jun 13 02:05:09.640070 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.640070 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt4bs\" (UniqueName: \"kubernetes.io/projected/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-kube-api-access-tt4bs\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.640314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.640314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-grpc-tls\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.640314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.640314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.640314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-tls\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.640480 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.640449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-metrics-client-ca\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741541 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-grpc-tls\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741541 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741541 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-tls\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-metrics-client-ca\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt4bs\" (UniqueName: \"kubernetes.io/projected/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-kube-api-access-tt4bs\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.741797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.741702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.742507 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.742475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-metrics-client-ca\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.744555 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.744529 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.744704 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.744681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-tls\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.744746 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.744727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.744782 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.744755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.744857 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.744838 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.744923 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.744906 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-secret-grpc-tls\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.749855 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.749835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt4bs\" (UniqueName: \"kubernetes.io/projected/4d7b79e6-7449-47a0-b09c-f6aa4c3c3366-kube-api-access-tt4bs\") pod \"thanos-querier-99d95bdb5-zk785\" (UID: \"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366\") " pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.757541 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.757517 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:09.890322 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:09.890294 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99d95bdb5-zk785"] Jun 13 02:05:09.892510 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:09.892485 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7b79e6_7449_47a0_b09c_f6aa4c3c3366.slice/crio-3a3867ba47dcd83277feb151419ee0076d5b8f0471128b95ecfbf924dd5c4973 WatchSource:0}: Error finding container 3a3867ba47dcd83277feb151419ee0076d5b8f0471128b95ecfbf924dd5c4973: Status 404 returned error can't find the container with id 3a3867ba47dcd83277feb151419ee0076d5b8f0471128b95ecfbf924dd5c4973 Jun 13 02:05:10.532515 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:10.532484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" event={"ID":"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366","Type":"ContainerStarted","Data":"3a3867ba47dcd83277feb151419ee0076d5b8f0471128b95ecfbf924dd5c4973"} Jun 13 02:05:11.232419 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.232384 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg"] Jun 13 02:05:11.236925 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.236891 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.239457 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.239429 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 13 02:05:11.239593 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.239494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gdhc8\"" Jun 13 02:05:11.242674 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.242650 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg"] Jun 13 02:05:11.254216 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.254194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsmbm\" (UniqueName: \"kubernetes.io/projected/a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3-kube-api-access-gsmbm\") pod \"monitoring-plugin-589576dfc7-tcjpg\" (UID: \"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.254336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.254249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-tcjpg\" (UID: \"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.355012 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.354955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsmbm\" (UniqueName: \"kubernetes.io/projected/a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3-kube-api-access-gsmbm\") pod \"monitoring-plugin-589576dfc7-tcjpg\" (UID: \"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.355207 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.355034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-tcjpg\" (UID: \"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.358083 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.358054 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-tcjpg\" (UID: \"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.363445 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.363420 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsmbm\" (UniqueName: \"kubernetes.io/projected/a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3-kube-api-access-gsmbm\") pod \"monitoring-plugin-589576dfc7-tcjpg\" (UID: \"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.549837 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.549753 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:11.635716 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.635680 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5cc5d95d74-7h54p"] Jun 13 02:05:11.639146 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.639125 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.642005 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.641948 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 13 02:05:11.642005 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.641954 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 13 02:05:11.642206 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.642018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 13 02:05:11.642283 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.642229 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zgzjm\"" Jun 13 02:05:11.642345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.642302 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 13 02:05:11.642408 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.642384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 13 02:05:11.649150 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.649037 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 13 02:05:11.650582 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.650554 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cc5d95d74-7h54p"] Jun 13 02:05:11.656538 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-telemeter-client-tls\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.656640 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnj5d\" (UniqueName: \"kubernetes.io/projected/cd6b4f24-4c29-4400-a628-43bf595e7ab4-kube-api-access-tnj5d\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.656640 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-secret-telemeter-client\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.656640 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.656843 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-serving-certs-ca-bundle\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.656843 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.656843 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-federate-client-tls\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.656999 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.656888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-metrics-client-ca\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758162 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-federate-client-tls\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-metrics-client-ca\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-telemeter-client-tls\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnj5d\" (UniqueName: \"kubernetes.io/projected/cd6b4f24-4c29-4400-a628-43bf595e7ab4-kube-api-access-tnj5d\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-secret-telemeter-client\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758625 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-serving-certs-ca-bundle\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.758625 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.758406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.759167 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.759135 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-metrics-client-ca\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.759313 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.759288 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.759368 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.759317 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd6b4f24-4c29-4400-a628-43bf595e7ab4-serving-certs-ca-bundle\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.761338 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.761311 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.761338 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.761329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-federate-client-tls\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.761521 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.761473 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-secret-telemeter-client\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.761737 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.761712 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cd6b4f24-4c29-4400-a628-43bf595e7ab4-telemeter-client-tls\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.767734 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.767715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnj5d\" (UniqueName: \"kubernetes.io/projected/cd6b4f24-4c29-4400-a628-43bf595e7ab4-kube-api-access-tnj5d\") pod \"telemeter-client-5cc5d95d74-7h54p\" (UID: \"cd6b4f24-4c29-4400-a628-43bf595e7ab4\") " pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:11.952224 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:11.952191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" Jun 13 02:05:12.101092 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.101061 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cc5d95d74-7h54p"] Jun 13 02:05:12.105140 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:12.105113 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6b4f24_4c29_4400_a628_43bf595e7ab4.slice/crio-0b3386390a88fd1de3c908e3906fe3405c89f27240a9caece8927afc8ffcfcb0 WatchSource:0}: Error finding container 0b3386390a88fd1de3c908e3906fe3405c89f27240a9caece8927afc8ffcfcb0: Status 404 returned error can't find the container with id 0b3386390a88fd1de3c908e3906fe3405c89f27240a9caece8927afc8ffcfcb0 Jun 13 02:05:12.110865 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.110801 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg"] Jun 13 02:05:12.113619 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:12.113589 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6facac7_9ca7_4cfe_b65e_6b36c4ba49b3.slice/crio-6560b3021eface35ffd15fee3450060b04b83b3061e43ef56f95601d347cb2d1 WatchSource:0}: Error finding container 6560b3021eface35ffd15fee3450060b04b83b3061e43ef56f95601d347cb2d1: Status 404 returned error can't find the container with id 6560b3021eface35ffd15fee3450060b04b83b3061e43ef56f95601d347cb2d1 Jun 13 02:05:12.542753 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.542656 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" event={"ID":"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366","Type":"ContainerStarted","Data":"ab9acf0ef08e50bc673aa472f1ccfc2f83a3379c730e1eee460291603056aada"} Jun 13 02:05:12.542753 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.542731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" event={"ID":"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366","Type":"ContainerStarted","Data":"dd469842d45c019473d7d766118f287dc57b9882f5ee0c6a69c09f7147d3b2dc"} Jun 13 02:05:12.542950 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.542774 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" event={"ID":"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366","Type":"ContainerStarted","Data":"3e15888811afba86ad753c3cb51b8d426a27d979a3d839a8be6885e5b41d7d96"} Jun 13 02:05:12.543912 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.543880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" event={"ID":"cd6b4f24-4c29-4400-a628-43bf595e7ab4","Type":"ContainerStarted","Data":"0b3386390a88fd1de3c908e3906fe3405c89f27240a9caece8927afc8ffcfcb0"} Jun 13 02:05:12.545129 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.545110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" event={"ID":"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3","Type":"ContainerStarted","Data":"6560b3021eface35ffd15fee3450060b04b83b3061e43ef56f95601d347cb2d1"} Jun 13 02:05:12.596475 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.596420 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:05:12.601024 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.600995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.603949 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.603988 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.604012 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ntx8w\"" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.604021 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.603954 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.604104 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.604148 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 13 02:05:12.604246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.604103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a9p0vkiqt93ov\"" Jun 13 02:05:12.605022 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605003 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 13 02:05:12.605294 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605274 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 13 02:05:12.605408 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605293 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 13 02:05:12.605408 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605308 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 13 02:05:12.605408 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605397 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 02:05:12.605577 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605275 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 13 02:05:12.605627 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 13 02:05:12.605831 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.605811 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 13 02:05:12.607422 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.607401 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 13 02:05:12.618526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.618435 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:05:12.666471 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.666636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.666636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.666636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.666636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.666636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.666636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.666636 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-config\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.666962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n49f\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-kube-api-access-7n49f\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667502 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.667027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.667502 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.667055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768435 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768647 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768906 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768906 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768906 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768906 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768906 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.768906 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-config\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.768994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n49f\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-kube-api-access-7n49f\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.769673 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.769622 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.770134 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.770103 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.770759 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.770730 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.771078 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.771055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.776434 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.772498 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.776434 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.773045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.776434 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.775723 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.776434 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.776101 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.776434 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.776168 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.776434 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.776384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.776777 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.776699 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.777288 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.777247 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.777833 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.777789 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.778782 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.778352 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.779340 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.779206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.779434 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.779339 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-config\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.780800 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.780753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.781701 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.781683 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n49f\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-kube-api-access-7n49f\") pod \"prometheus-k8s-0\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:12.913160 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:12.913115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:13.103805 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:13.103776 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:05:13.166623 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:13.166469 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92299d9a_86af_463a_a29b_040b38326b43.slice/crio-b3c1b0fff419853a727421203e71591a7cc1c388f460776d9444012674c42afe WatchSource:0}: Error finding container b3c1b0fff419853a727421203e71591a7cc1c388f460776d9444012674c42afe: Status 404 returned error can't find the container with id b3c1b0fff419853a727421203e71591a7cc1c388f460776d9444012674c42afe Jun 13 02:05:13.563858 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:13.563815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" event={"ID":"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366","Type":"ContainerStarted","Data":"c0fc4aa8b698062c45ef91553c6a37dbeee860ace617d95256ceacdc0cf9dace"} Jun 13 02:05:13.564053 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:13.564027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" event={"ID":"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366","Type":"ContainerStarted","Data":"9606ee3f1711b585ef3b0c9b4dc69951da939b9a2e1b78f47b359ff80ccf9db2"} Jun 13 02:05:13.564194 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:13.564097 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" event={"ID":"4d7b79e6-7449-47a0-b09c-f6aa4c3c3366","Type":"ContainerStarted","Data":"b4d1ce6400562d32cb0f9c7af1027f630794416a508f040cc9800cb9ec9d786c"} Jun 13 02:05:13.564889 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:13.564864 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:13.569309 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:13.569250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerStarted","Data":"b3c1b0fff419853a727421203e71591a7cc1c388f460776d9444012674c42afe"} Jun 13 02:05:13.588084 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:13.588028 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" podStartSLOduration=1.487214346 podStartE2EDuration="4.588006867s" totalImagesPullingTime="3.100792521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:13.586413902 +0000 UTC m=+259.305630697" watchObservedRunningTime="2026-06-13 02:05:13.588006867 +0000 UTC m=+259.307223649" Jun 13 02:05:14.695521 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:14.695448 2579 scope.go:117] "RemoveContainer" containerID="c7e314ceb318e6e7cdc574dc802033394b63a05f816c11afad424eb224db805c" Jun 13 02:05:14.695989 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:05:14.695641 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-h8tqk_openshift-console-operator(e4b3675a-8285-46c0-9dac-769eaa957c6b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" podUID="e4b3675a-8285-46c0-9dac-769eaa957c6b" Jun 13 02:05:15.581168 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.581129 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" event={"ID":"cd6b4f24-4c29-4400-a628-43bf595e7ab4","Type":"ContainerStarted","Data":"b7001d092ac95a37e4fcc971bde79de29e95725a373de602b04b3f8ccb5263ec"} Jun 13 02:05:15.581382 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.581195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" event={"ID":"cd6b4f24-4c29-4400-a628-43bf595e7ab4","Type":"ContainerStarted","Data":"49cf7ab1d28f1f3972557abcfb5570a0315e7151f6ec80a7e05422ccf0a37f9a"} Jun 13 02:05:15.581382 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.581221 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" event={"ID":"cd6b4f24-4c29-4400-a628-43bf595e7ab4","Type":"ContainerStarted","Data":"8c9eb0571a74af5665506ab9a36de938575cde62041bea9551d04520e6848555"} Jun 13 02:05:15.582703 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.582678 2579 generic.go:356] "Generic (PLEG): container finished" podID="92299d9a-86af-463a-a29b-040b38326b43" containerID="0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e" exitCode=0 Jun 13 02:05:15.582797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.582750 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e"} Jun 13 02:05:15.584013 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.583993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" event={"ID":"a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3","Type":"ContainerStarted","Data":"017e5a233d6a15d6e6c52dae0f2edcc38bddeea47b883c5eba2e68d0aeb82509"} Jun 13 02:05:15.584261 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.584248 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:15.589024 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.589005 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" Jun 13 02:05:15.603313 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.603268 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5cc5d95d74-7h54p" podStartSLOduration=1.849492219 podStartE2EDuration="4.603253561s" totalImagesPullingTime="2.753761342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:15.601051374 +0000 UTC m=+261.320268179" watchObservedRunningTime="2026-06-13 02:05:15.603253561 +0000 UTC m=+261.322470342" Jun 13 02:05:15.647159 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:15.647104 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-tcjpg" podStartSLOduration=1.900390876 podStartE2EDuration="4.647077654s" totalImagesPullingTime="2.746686778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:15.646856531 +0000 UTC m=+261.366073525" watchObservedRunningTime="2026-06-13 02:05:15.647077654 +0000 UTC m=+261.366294441" Jun 13 02:05:19.140933 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.140898 2579 patch_prober.go:28] interesting pod/image-registry-85956c6647-npmm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:19.141232 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.140954 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podUID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:19.581679 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.581651 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-99d95bdb5-zk785" Jun 13 02:05:19.609213 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.609185 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerStarted","Data":"764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f"} Jun 13 02:05:19.609384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.609241 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerStarted","Data":"a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f"} Jun 13 02:05:19.609384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.609268 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerStarted","Data":"4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea"} Jun 13 02:05:19.609384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.609292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerStarted","Data":"0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32"} Jun 13 02:05:19.609384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.609315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerStarted","Data":"d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4"} Jun 13 02:05:19.609384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.609338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerStarted","Data":"82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5"} Jun 13 02:05:19.639550 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:19.639502 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.645654966 podStartE2EDuration="7.639487268s" totalImagesPullingTime="4.96520731s" totalInitContainerRuntime="28.624992ms" isStatefulPod=false podCreationTimestamp="2026-06-13 02:05:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:19.637681478 +0000 UTC m=+265.356898280" watchObservedRunningTime="2026-06-13 02:05:19.639487268 +0000 UTC m=+265.358704048" Jun 13 02:05:20.486576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:20.486531 2579 patch_prober.go:28] interesting pod/image-registry-85956c6647-npmm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:20.487070 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:20.486951 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podUID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:22.913437 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:22.913407 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:05:26.693114 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:26.693078 2579 scope.go:117] "RemoveContainer" containerID="c7e314ceb318e6e7cdc574dc802033394b63a05f816c11afad424eb224db805c" Jun 13 02:05:27.641159 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:27.641132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:05:27.641332 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:27.641230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" event={"ID":"e4b3675a-8285-46c0-9dac-769eaa957c6b","Type":"ContainerStarted","Data":"5b528276a925671b89b4af99e1714d91a2cd28c2e5373b97db042a807ea6e59f"} Jun 13 02:05:27.641617 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:27.641594 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:05:27.646136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:27.646114 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" Jun 13 02:05:27.659444 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:27.659397 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-h8tqk" podStartSLOduration=55.095598731 podStartE2EDuration="57.659383255s" totalImagesPullingTime="2.563784524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:27.657413902 +0000 UTC m=+273.376630713" watchObservedRunningTime="2026-06-13 02:05:27.659383255 +0000 UTC m=+273.378600036" Jun 13 02:05:29.140429 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:29.140394 2579 patch_prober.go:28] interesting pod/image-registry-85956c6647-npmm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:29.140802 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:29.140457 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podUID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:30.485929 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:30.485883 2579 patch_prober.go:28] interesting pod/image-registry-85956c6647-npmm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:30.486404 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:30.485949 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podUID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:35.212707 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:05:35.212664 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5nqt5" podUID="ffd37432-108b-4c57-9054-734f6e410e3e" Jun 13 02:05:35.671037 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:35.671006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nqt5" Jun 13 02:05:39.109545 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.109496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:05:39.111873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.111854 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffd37432-108b-4c57-9054-734f6e410e3e-metrics-tls\") pod \"dns-default-5nqt5\" (UID: \"ffd37432-108b-4c57-9054-734f6e410e3e\") " pod="openshift-dns/dns-default-5nqt5" Jun 13 02:05:39.141288 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.141254 2579 patch_prober.go:28] interesting pod/image-registry-85956c6647-npmm6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:39.141548 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.141499 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podUID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:39.141670 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.141564 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:05:39.142062 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.142027 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"f06e19088b9c93671474380ff3cb613c837a37d90ff99b8859e0e9dea8cc9d38"} pod="openshift-image-registry/image-registry-85956c6647-npmm6" containerMessage="Container registry failed liveness probe, will be restarted" Jun 13 02:05:39.145722 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.145698 2579 patch_prober.go:28] interesting pod/image-registry-85956c6647-npmm6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 02:05:39.145834 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.145747 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podUID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:05:39.274346 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.274315 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bc58g\"" Jun 13 02:05:39.281698 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.281674 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5nqt5" Jun 13 02:05:39.437591 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.437567 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5nqt5"] Jun 13 02:05:39.439511 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:05:39.439483 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd37432_108b_4c57_9054_734f6e410e3e.slice/crio-7ac78b6a880ebdee4d56a908945cb2c6925eb127e8dddb6d5f4587e4329ffff0 WatchSource:0}: Error finding container 7ac78b6a880ebdee4d56a908945cb2c6925eb127e8dddb6d5f4587e4329ffff0: Status 404 returned error can't find the container with id 7ac78b6a880ebdee4d56a908945cb2c6925eb127e8dddb6d5f4587e4329ffff0 Jun 13 02:05:39.687481 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:39.687443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nqt5" event={"ID":"ffd37432-108b-4c57-9054-734f6e410e3e","Type":"ContainerStarted","Data":"7ac78b6a880ebdee4d56a908945cb2c6925eb127e8dddb6d5f4587e4329ffff0"} Jun 13 02:05:41.696776 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:41.696739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nqt5" event={"ID":"ffd37432-108b-4c57-9054-734f6e410e3e","Type":"ContainerStarted","Data":"1fa83daa7a5b76c680101b789d6a5a68885d82434a7624378fecb5b22710ca77"} Jun 13 02:05:41.697319 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:41.696827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5nqt5" event={"ID":"ffd37432-108b-4c57-9054-734f6e410e3e","Type":"ContainerStarted","Data":"103a20dd6608a4f0e3d46392c2d6f0c160daf204adaa40070575a491418cd15a"} Jun 13 02:05:41.697319 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:41.696878 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5nqt5" Jun 13 02:05:41.715243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:41.715200 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5nqt5" podStartSLOduration=251.010025886 podStartE2EDuration="4m12.715184787s" totalImagesPullingTime="1.705158901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:05:41.71288938 +0000 UTC m=+287.432106195" watchObservedRunningTime="2026-06-13 02:05:41.715184787 +0000 UTC m=+287.434401581" Jun 13 02:05:44.707776 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:44.707738 2579 generic.go:356] "Generic (PLEG): container finished" podID="8d851dde-c50a-4fa6-a2ad-55117976e969" containerID="079467735ce05ed44b9aa37b6d52d2f764e00fb3c79a5c36c6d254b90dcf3d8c" exitCode=0 Jun 13 02:05:44.708167 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:44.707806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" event={"ID":"8d851dde-c50a-4fa6-a2ad-55117976e969","Type":"ContainerDied","Data":"079467735ce05ed44b9aa37b6d52d2f764e00fb3c79a5c36c6d254b90dcf3d8c"} Jun 13 02:05:44.708167 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:44.708135 2579 scope.go:117] "RemoveContainer" containerID="079467735ce05ed44b9aa37b6d52d2f764e00fb3c79a5c36c6d254b90dcf3d8c" Jun 13 02:05:45.714085 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:45.714047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-g4dbl" event={"ID":"8d851dde-c50a-4fa6-a2ad-55117976e969","Type":"ContainerStarted","Data":"9c6c61b2c0a03ca04c17e1e12d820d9014651072bf707db7e23ed6c34479c176"} Jun 13 02:05:49.158311 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:49.158271 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:05:51.702533 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:51.702497 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5nqt5" Jun 13 02:05:54.648913 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:54.648880 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:05:54.650645 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:54.650621 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:05:54.656824 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:54.656805 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:05:54.658484 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:54.658467 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:05:54.660550 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:05:54.660527 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 02:06:02.267259 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:02.267221 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-287mj_0cd1160d-48b3-44a6-9471-d070ceb2af7f/cluster-monitoring-operator/0.log" Jun 13 02:06:03.266707 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:03.266675 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-tcjpg_a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3/monitoring-plugin/0.log" Jun 13 02:06:03.465369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:03.465342 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkbp4_46a3b27f-0763-4000-a79a-52d1a4ebf406/init-textfile/0.log" Jun 13 02:06:03.670262 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:03.670218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkbp4_46a3b27f-0763-4000-a79a-52d1a4ebf406/node-exporter/0.log" Jun 13 02:06:03.873889 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:03.873858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkbp4_46a3b27f-0763-4000-a79a-52d1a4ebf406/kube-rbac-proxy/0.log" Jun 13 02:06:04.162687 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:04.162645 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85956c6647-npmm6" podUID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerName="registry" containerID="cri-o://f06e19088b9c93671474380ff3cb613c837a37d90ff99b8859e0e9dea8cc9d38" gracePeriod=30 Jun 13 02:06:05.794209 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:05.794177 2579 generic.go:356] "Generic (PLEG): container finished" podID="6e52dd83-00e2-4e84-9ee6-e27b578d1ef1" containerID="f06e19088b9c93671474380ff3cb613c837a37d90ff99b8859e0e9dea8cc9d38" exitCode=0 Jun 13 02:06:05.794610 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:05.794269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85956c6647-npmm6" event={"ID":"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1","Type":"ContainerDied","Data":"f06e19088b9c93671474380ff3cb613c837a37d90ff99b8859e0e9dea8cc9d38"} Jun 13 02:06:05.794610 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:05.794329 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:06:05.794610 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:05.794352 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85956c6647-npmm6" event={"ID":"6e52dd83-00e2-4e84-9ee6-e27b578d1ef1","Type":"ContainerStarted","Data":"83e4bd114ad52a66c30edbbcd57ae611a10a80fb4fd2cd633843f40b985d38ae"} Jun 13 02:06:05.867940 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:05.867905 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92299d9a-86af-463a-a29b-040b38326b43/init-config-reloader/0.log" Jun 13 02:06:06.069897 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:06.069814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92299d9a-86af-463a-a29b-040b38326b43/prometheus/0.log" Jun 13 02:06:06.265837 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:06.265801 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92299d9a-86af-463a-a29b-040b38326b43/config-reloader/0.log" Jun 13 02:06:06.466526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:06.466492 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92299d9a-86af-463a-a29b-040b38326b43/thanos-sidecar/0.log" Jun 13 02:06:06.665848 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:06.665821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92299d9a-86af-463a-a29b-040b38326b43/kube-rbac-proxy-web/0.log" Jun 13 02:06:06.865551 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:06.865463 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92299d9a-86af-463a-a29b-040b38326b43/kube-rbac-proxy/0.log" Jun 13 02:06:07.065801 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:07.065771 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92299d9a-86af-463a-a29b-040b38326b43/kube-rbac-proxy-thanos/0.log" Jun 13 02:06:07.269051 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:07.269018 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-b6nzr_70661726-4073-4046-8487-4fac68c94a68/prometheus-operator/0.log" Jun 13 02:06:07.466013 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:07.465961 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-b6nzr_70661726-4073-4046-8487-4fac68c94a68/kube-rbac-proxy/0.log" Jun 13 02:06:07.865614 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:07.865571 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5d95d74-7h54p_cd6b4f24-4c29-4400-a628-43bf595e7ab4/telemeter-client/0.log" Jun 13 02:06:08.065985 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:08.065956 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5d95d74-7h54p_cd6b4f24-4c29-4400-a628-43bf595e7ab4/reload/0.log" Jun 13 02:06:08.284022 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:08.283963 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5d95d74-7h54p_cd6b4f24-4c29-4400-a628-43bf595e7ab4/kube-rbac-proxy/0.log" Jun 13 02:06:08.466583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:08.466551 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/thanos-query/0.log" Jun 13 02:06:08.666098 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:08.666072 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy-web/0.log" Jun 13 02:06:08.865376 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:08.865343 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy/0.log" Jun 13 02:06:09.065810 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:09.065735 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/prom-label-proxy/0.log" Jun 13 02:06:09.265685 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:09.265655 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy-rules/0.log" Jun 13 02:06:09.466034 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:09.466005 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy-metrics/0.log" Jun 13 02:06:09.865935 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:09.865862 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:06:10.067873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:10.067844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/3.log" Jun 13 02:06:11.265763 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:11.265732 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkn7z_f4ff27f7-358b-4260-a1f3-db51fb25c450/serve-healthcheck-canary/0.log" Jun 13 02:06:12.914203 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:12.914170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:12.934305 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:12.934274 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:13.842269 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:13.842234 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:26.802139 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:26.802108 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85956c6647-npmm6" Jun 13 02:06:30.904126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:30.904092 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:06:30.905021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:30.904967 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="prometheus" containerID="cri-o://82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5" gracePeriod=600 Jun 13 02:06:30.905563 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:30.905198 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-thanos" containerID="cri-o://764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f" gracePeriod=600 Jun 13 02:06:30.905673 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:30.905360 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="thanos-sidecar" containerID="cri-o://0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32" gracePeriod=600 Jun 13 02:06:30.905673 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:30.905382 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy" containerID="cri-o://a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f" gracePeriod=600 Jun 13 02:06:30.905784 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:30.905400 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-web" containerID="cri-o://4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea" gracePeriod=600 Jun 13 02:06:30.905784 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:30.905425 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="config-reloader" containerID="cri-o://d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4" gracePeriod=600 Jun 13 02:06:31.899243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899209 2579 generic.go:356] "Generic (PLEG): container finished" podID="92299d9a-86af-463a-a29b-040b38326b43" containerID="764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f" exitCode=0 Jun 13 02:06:31.899243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899234 2579 generic.go:356] "Generic (PLEG): container finished" podID="92299d9a-86af-463a-a29b-040b38326b43" containerID="a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f" exitCode=0 Jun 13 02:06:31.899243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899241 2579 generic.go:356] "Generic (PLEG): container finished" podID="92299d9a-86af-463a-a29b-040b38326b43" containerID="0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32" exitCode=0 Jun 13 02:06:31.899243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899248 2579 generic.go:356] "Generic (PLEG): container finished" podID="92299d9a-86af-463a-a29b-040b38326b43" containerID="d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4" exitCode=0 Jun 13 02:06:31.899519 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899255 2579 generic.go:356] "Generic (PLEG): container finished" podID="92299d9a-86af-463a-a29b-040b38326b43" containerID="82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5" exitCode=0 Jun 13 02:06:31.899519 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f"} Jun 13 02:06:31.899519 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899340 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f"} Jun 13 02:06:31.899519 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32"} Jun 13 02:06:31.899519 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4"} Jun 13 02:06:31.899519 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:31.899414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5"} Jun 13 02:06:32.161178 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.161150 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:32.278317 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278280 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-metrics-client-certs\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278317 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278319 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-serving-certs-ca-bundle\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278341 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-tls-assets\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278358 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-0\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278395 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-metrics-client-ca\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278419 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278794 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278596 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n49f\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-kube-api-access-7n49f\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278794 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278649 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-kubelet-serving-ca-bundle\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278794 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278685 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-1\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278794 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278711 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-tls\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278794 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278744 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.278794 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278781 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-thanos-prometheus-http-client-file\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278801 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278813 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-trusted-ca-bundle\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278855 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-config-out\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278892 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-web-config\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278920 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-grpc-tls\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.278952 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-config\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279004 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-db\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279045 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-kube-rbac-proxy\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279070 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-2\") pod \"92299d9a-86af-463a-a29b-040b38326b43\" (UID: \"92299d9a-86af-463a-a29b-040b38326b43\") " Jun 13 02:06:32.279118 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279090 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:32.279616 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279364 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-metrics-client-ca\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.279616 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279387 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.279616 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279448 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:32.279778 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.279671 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:32.280168 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.280139 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:32.280679 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.280653 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:06:32.281456 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.281238 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.281456 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.281304 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:32.281456 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.281400 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-kube-api-access-7n49f" (OuterVolumeSpecName: "kube-api-access-7n49f") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "kube-api-access-7n49f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:06:32.281851 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.281761 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:32.281931 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.281853 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.282235 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.282190 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-config" (OuterVolumeSpecName: "config") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.282532 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.282465 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.282532 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.282516 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 02:06:32.282959 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.282935 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-config-out" (OuterVolumeSpecName: "config-out") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:06:32.283102 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.283083 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.283621 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.283603 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.284025 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.284006 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.284287 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.284263 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.295177 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.295149 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-web-config" (OuterVolumeSpecName: "web-config") pod "92299d9a-86af-463a-a29b-040b38326b43" (UID: "92299d9a-86af-463a-a29b-040b38326b43"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 02:06:32.380646 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380607 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-config-out\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380646 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380637 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-web-config\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380646 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380647 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-grpc-tls\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380646 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380655 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-config\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380664 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-db\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380674 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-kube-rbac-proxy\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380683 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380692 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-metrics-client-certs\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380701 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380711 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-tls-assets\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380721 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380732 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380740 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n49f\" (UniqueName: \"kubernetes.io/projected/92299d9a-86af-463a-a29b-040b38326b43-kube-api-access-7n49f\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380749 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380757 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380766 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380774 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92299d9a-86af-463a-a29b-040b38326b43-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.380907 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.380782 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92299d9a-86af-463a-a29b-040b38326b43-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:06:32.906559 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.906480 2579 generic.go:356] "Generic (PLEG): container finished" podID="92299d9a-86af-463a-a29b-040b38326b43" containerID="4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea" exitCode=0 Jun 13 02:06:32.906679 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.906551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea"} Jun 13 02:06:32.906679 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.906566 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:32.906679 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.906623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92299d9a-86af-463a-a29b-040b38326b43","Type":"ContainerDied","Data":"b3c1b0fff419853a727421203e71591a7cc1c388f460776d9444012674c42afe"} Jun 13 02:06:32.906679 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.906663 2579 scope.go:117] "RemoveContainer" containerID="764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f" Jun 13 02:06:32.918850 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.915232 2579 scope.go:117] "RemoveContainer" containerID="a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f" Jun 13 02:06:32.923648 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.923623 2579 scope.go:117] "RemoveContainer" containerID="4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea" Jun 13 02:06:32.930824 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.930806 2579 scope.go:117] "RemoveContainer" containerID="0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32" Jun 13 02:06:32.933392 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.933368 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:06:32.937797 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.937767 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:06:32.938595 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.938575 2579 scope.go:117] "RemoveContainer" containerID="d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4" Jun 13 02:06:32.945494 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.945479 2579 scope.go:117] "RemoveContainer" containerID="82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5" Jun 13 02:06:32.952959 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.952937 2579 scope.go:117] "RemoveContainer" containerID="0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e" Jun 13 02:06:32.960064 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960042 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:06:32.960133 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960116 2579 scope.go:117] "RemoveContainer" containerID="764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f" Jun 13 02:06:32.960399 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960384 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy" Jun 13 02:06:32.960449 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960403 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy" Jun 13 02:06:32.960449 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:06:32.960406 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f\": container with ID starting with 764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f not found: ID does not exist" containerID="764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f" Jun 13 02:06:32.960449 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960425 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-web" Jun 13 02:06:32.960449 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960434 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-web" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960440 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f"} err="failed to get container status \"764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f\": rpc error: code = NotFound desc = could not find container \"764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f\": container with ID starting with 764ad896ba2021bb144b70594463c40accb231948fd1d53b7f0bef7f5776236f not found: ID does not exist" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960460 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="config-reloader" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960467 2579 scope.go:117] "RemoveContainer" containerID="a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960469 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="config-reloader" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960521 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="init-config-reloader" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960528 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="init-config-reloader" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960545 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="thanos-sidecar" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960554 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="thanos-sidecar" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960562 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-thanos" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960567 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-thanos" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960574 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="prometheus" Jun 13 02:06:32.960576 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960580 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="prometheus" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960643 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-web" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960655 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="prometheus" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960663 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960669 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="config-reloader" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960674 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="kube-rbac-proxy-thanos" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960683 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92299d9a-86af-463a-a29b-040b38326b43" containerName="thanos-sidecar" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:06:32.960771 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f\": container with ID starting with a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f not found: ID does not exist" containerID="a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960796 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f"} err="failed to get container status \"a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f\": rpc error: code = NotFound desc = could not find container \"a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f\": container with ID starting with a71ad1dd224d44083da148cb1cf74edf8cce63504a415a922a0a94a450cd8f7f not found: ID does not exist" Jun 13 02:06:32.961021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.960814 2579 scope.go:117] "RemoveContainer" containerID="4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea" Jun 13 02:06:32.961333 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:06:32.961083 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea\": container with ID starting with 4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea not found: ID does not exist" containerID="4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea" Jun 13 02:06:32.961333 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.961111 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea"} err="failed to get container status \"4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea\": rpc error: code = NotFound desc = could not find container \"4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea\": container with ID starting with 4d92ff2ff1e64f6fac1f2685c5c359dce43352b71fd21b035b6cdf9767e8c9ea not found: ID does not exist" Jun 13 02:06:32.961333 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.961133 2579 scope.go:117] "RemoveContainer" containerID="0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32" Jun 13 02:06:32.961476 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:06:32.961384 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32\": container with ID starting with 0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32 not found: ID does not exist" containerID="0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32" Jun 13 02:06:32.961476 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.961413 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32"} err="failed to get container status \"0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32\": rpc error: code = NotFound desc = could not find container \"0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32\": container with ID starting with 0939b4233a4ee2e0f55d609eff6ae8585a835f1c55591c6454df645953032c32 not found: ID does not exist" Jun 13 02:06:32.961476 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.961434 2579 scope.go:117] "RemoveContainer" containerID="d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4" Jun 13 02:06:32.961698 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:06:32.961680 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4\": container with ID starting with d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4 not found: ID does not exist" containerID="d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4" Jun 13 02:06:32.961739 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.961702 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4"} err="failed to get container status \"d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4\": rpc error: code = NotFound desc = could not find container \"d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4\": container with ID starting with d7942ba7d64d8be579ccda3792ec93e84494c7d812c90ebe1e3602ff1d4d8ba4 not found: ID does not exist" Jun 13 02:06:32.961739 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.961717 2579 scope.go:117] "RemoveContainer" containerID="82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5" Jun 13 02:06:32.961984 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:06:32.961948 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5\": container with ID starting with 82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5 not found: ID does not exist" containerID="82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5" Jun 13 02:06:32.962040 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.962003 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5"} err="failed to get container status \"82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5\": rpc error: code = NotFound desc = could not find container \"82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5\": container with ID starting with 82c2b82b15f5402e6ab1a1b058ab0fdb805bdcf0de4f448da218bacc267a5da5 not found: ID does not exist" Jun 13 02:06:32.962040 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.962025 2579 scope.go:117] "RemoveContainer" containerID="0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e" Jun 13 02:06:32.962260 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:06:32.962245 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e\": container with ID starting with 0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e not found: ID does not exist" containerID="0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e" Jun 13 02:06:32.962301 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.962264 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e"} err="failed to get container status \"0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e\": rpc error: code = NotFound desc = could not find container \"0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e\": container with ID starting with 0c965d41ba5ab09007cc6ebf3b4c6ec09eb5108c6f14aaf8a3c272ce4cfe403e not found: ID does not exist" Jun 13 02:06:32.966069 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.966047 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:32.969325 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969232 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 13 02:06:32.969325 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969261 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 13 02:06:32.969325 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969270 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 13 02:06:32.969559 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969362 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a9p0vkiqt93ov\"" Jun 13 02:06:32.969559 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 13 02:06:32.969559 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969415 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 13 02:06:32.969559 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969263 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 13 02:06:32.969807 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969755 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ntx8w\"" Jun 13 02:06:32.969807 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969760 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 13 02:06:32.969955 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.969810 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 13 02:06:32.970123 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.970106 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 13 02:06:32.970123 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.970118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 13 02:06:32.970360 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.970341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 13 02:06:32.970475 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.970363 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 02:06:32.970475 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.970385 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 13 02:06:32.973584 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.973564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 13 02:06:32.975498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.975480 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 13 02:06:32.981473 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:32.981454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:06:33.086894 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.086856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42ad4945-e424-4379-8bc7-e5aace686d0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.086894 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.086896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.086919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.086966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42ad4945-e424-4379-8bc7-e5aace686d0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087136 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-config\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgmx\" (UniqueName: \"kubernetes.io/projected/42ad4945-e424-4379-8bc7-e5aace686d0e-kube-api-access-msgmx\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087345 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087569 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087569 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.087569 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.087418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.188372 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.188804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-config\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.188804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.188804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.188804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188625 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.188804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgmx\" (UniqueName: \"kubernetes.io/projected/42ad4945-e424-4379-8bc7-e5aace686d0e-kube-api-access-msgmx\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.188998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42ad4945-e424-4379-8bc7-e5aace686d0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42ad4945-e424-4379-8bc7-e5aace686d0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189326 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189770 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.189770 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.190161 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.190135 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.191540 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.191510 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-config\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192183 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192299 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192210 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192299 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192665 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42ad4945-e424-4379-8bc7-e5aace686d0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192736 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.189086 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192843 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/42ad4945-e424-4379-8bc7-e5aace686d0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.192918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.192902 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ad4945-e424-4379-8bc7-e5aace686d0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.193267 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.193177 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42ad4945-e424-4379-8bc7-e5aace686d0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.194433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.194404 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.194649 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.194634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.195320 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.195299 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.195381 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.195329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42ad4945-e424-4379-8bc7-e5aace686d0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.197414 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.197390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgmx\" (UniqueName: \"kubernetes.io/projected/42ad4945-e424-4379-8bc7-e5aace686d0e-kube-api-access-msgmx\") pod \"prometheus-k8s-0\" (UID: \"42ad4945-e424-4379-8bc7-e5aace686d0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.280241 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.280196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:06:33.423126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.423099 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 02:06:33.424921 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:06:33.424897 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ad4945_e424_4379_8bc7_e5aace686d0e.slice/crio-02dec5000bd77356a3928027dd98758746591a1dc358b154cc9ded14c3254947 WatchSource:0}: Error finding container 02dec5000bd77356a3928027dd98758746591a1dc358b154cc9ded14c3254947: Status 404 returned error can't find the container with id 02dec5000bd77356a3928027dd98758746591a1dc358b154cc9ded14c3254947 Jun 13 02:06:33.912464 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.912429 2579 generic.go:356] "Generic (PLEG): container finished" podID="42ad4945-e424-4379-8bc7-e5aace686d0e" containerID="be001754880954fe328df0f03556594b0594a4643c758cc609daa54322081aaa" exitCode=0 Jun 13 02:06:33.912659 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.912528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerDied","Data":"be001754880954fe328df0f03556594b0594a4643c758cc609daa54322081aaa"} Jun 13 02:06:33.912659 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:33.912600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerStarted","Data":"02dec5000bd77356a3928027dd98758746591a1dc358b154cc9ded14c3254947"} Jun 13 02:06:34.701848 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.699291 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92299d9a-86af-463a-a29b-040b38326b43" path="/var/lib/kubelet/pods/92299d9a-86af-463a-a29b-040b38326b43/volumes" Jun 13 02:06:34.920884 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.920846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerStarted","Data":"aa2f612201ca39c6b0b998e317a3f904d887087378bb26ef32e6828fcecd59a4"} Jun 13 02:06:34.921047 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.920929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerStarted","Data":"700e107f597f2de817c8fabcbaadd90217011f3aab01d49a7ac419b6e2777455"} Jun 13 02:06:34.921047 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.920994 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerStarted","Data":"a381e337d5a9547e3482450e3e6cd65966edc414635a4b300c94fdc3706bdc1f"} Jun 13 02:06:34.921047 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.921031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerStarted","Data":"9358a45ec61c508253a96cc8752431928127bedcc4fcc3f4d851bf66f66d7609"} Jun 13 02:06:34.921175 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.921073 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerStarted","Data":"7863b7b1a963f811cad199449da1ecbb19ecc4a83c9b12130d7073f5ce4bca12"} Jun 13 02:06:34.921175 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.921107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"42ad4945-e424-4379-8bc7-e5aace686d0e","Type":"ContainerStarted","Data":"b0130782eb483e884429569dac3c9ec2a7677ff8dc5eb3ebf9bfd4f1facacd67"} Jun 13 02:06:34.947125 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:34.947052 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.928835682 podStartE2EDuration="2.947011236s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.175554ms" isStatefulPod=false podCreationTimestamp="2026-06-13 02:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:06:34.945336684 +0000 UTC m=+340.664553523" watchObservedRunningTime="2026-06-13 02:06:34.947011236 +0000 UTC m=+340.666228018" Jun 13 02:06:38.280810 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:06:38.280698 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:07:33.280682 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:07:33.280638 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:07:33.295922 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:07:33.295898 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:07:34.179628 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:07:34.179597 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 02:08:32.642667 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.642636 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2"] Jun 13 02:08:32.646315 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.646285 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.649837 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.649810 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5ldbz\"" Jun 13 02:08:32.650064 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.649932 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 02:08:32.650161 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.650067 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 02:08:32.650237 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.650216 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 02:08:32.650832 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.650815 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 02:08:32.662858 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.662832 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2"] Jun 13 02:08:32.718358 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.718320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d778542-1108-4df0-911e-577c32dfca62-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.718570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.718376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d778542-1108-4df0-911e-577c32dfca62-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.718570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.718486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d778542-1108-4df0-911e-577c32dfca62-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.718570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.718542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98qrt\" (UniqueName: \"kubernetes.io/projected/3d778542-1108-4df0-911e-577c32dfca62-kube-api-access-98qrt\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.718707 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.718592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d778542-1108-4df0-911e-577c32dfca62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.819898 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.819857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d778542-1108-4df0-911e-577c32dfca62-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.820125 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.820021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d778542-1108-4df0-911e-577c32dfca62-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.820125 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.820089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98qrt\" (UniqueName: \"kubernetes.io/projected/3d778542-1108-4df0-911e-577c32dfca62-kube-api-access-98qrt\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.820254 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.820125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d778542-1108-4df0-911e-577c32dfca62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.820254 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.820185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d778542-1108-4df0-911e-577c32dfca62-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.820353 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.820274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d778542-1108-4df0-911e-577c32dfca62-manifests\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.822542 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.822514 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d778542-1108-4df0-911e-577c32dfca62-tmp\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.822683 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.822520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d778542-1108-4df0-911e-577c32dfca62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.822761 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.822689 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d778542-1108-4df0-911e-577c32dfca62-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.831581 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.831550 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98qrt\" (UniqueName: \"kubernetes.io/projected/3d778542-1108-4df0-911e-577c32dfca62-kube-api-access-98qrt\") pod \"opendatahub-operator-controller-manager-76bc779c54-vjbc2\" (UID: \"3d778542-1108-4df0-911e-577c32dfca62\") " pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:32.957579 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:32.957538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:33.101622 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:33.101590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2"] Jun 13 02:08:33.104371 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:08:33.104345 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d778542_1108_4df0_911e_577c32dfca62.slice/crio-e84584dabb6cb49fb003e94141b04efcb185e1b4fbf08400c0b567ca1713298d WatchSource:0}: Error finding container e84584dabb6cb49fb003e94141b04efcb185e1b4fbf08400c0b567ca1713298d: Status 404 returned error can't find the container with id e84584dabb6cb49fb003e94141b04efcb185e1b4fbf08400c0b567ca1713298d Jun 13 02:08:33.106154 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:33.106136 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:08:33.401555 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:33.401461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" event={"ID":"3d778542-1108-4df0-911e-577c32dfca62","Type":"ContainerStarted","Data":"e84584dabb6cb49fb003e94141b04efcb185e1b4fbf08400c0b567ca1713298d"} Jun 13 02:08:36.417142 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:36.417103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" event={"ID":"3d778542-1108-4df0-911e-577c32dfca62","Type":"ContainerStarted","Data":"9b6401ac26e9b923940a599c914d674ba93a473d21b34b07f7c86d67d2674ba8"} Jun 13 02:08:37.422944 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:37.422902 2579 generic.go:356] "Generic (PLEG): container finished" podID="3d778542-1108-4df0-911e-577c32dfca62" containerID="9b6401ac26e9b923940a599c914d674ba93a473d21b34b07f7c86d67d2674ba8" exitCode=0 Jun 13 02:08:37.423401 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:37.423007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" event={"ID":"3d778542-1108-4df0-911e-577c32dfca62","Type":"ContainerDied","Data":"9b6401ac26e9b923940a599c914d674ba93a473d21b34b07f7c86d67d2674ba8"} Jun 13 02:08:38.428826 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:38.428794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" event={"ID":"3d778542-1108-4df0-911e-577c32dfca62","Type":"ContainerStarted","Data":"0ee10a8f53deb21e96156e52adb86aa814ebb5e15567b7fc3d1ee8964e93c585"} Jun 13 02:08:38.429230 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:38.428876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:38.453544 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:38.453483 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" podStartSLOduration=2.073745448 podStartE2EDuration="6.453465323s" totalImagesPullingTime="3.346143518s" totalInitContainerRuntime="1.033576357s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:38.451019959 +0000 UTC m=+464.170236762" watchObservedRunningTime="2026-06-13 02:08:38.453465323 +0000 UTC m=+464.172682103" Jun 13 02:08:49.435932 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:49.435894 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76bc779c54-vjbc2" Jun 13 02:08:51.697985 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.697935 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw"] Jun 13 02:08:51.708198 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.708156 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.712073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.712049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8zwl5\"" Jun 13 02:08:51.712073 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.712060 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 02:08:51.712433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.712411 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw"] Jun 13 02:08:51.713198 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.713174 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 02:08:51.713198 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.713193 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 02:08:51.713381 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.713175 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 02:08:51.713381 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.713253 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 02:08:51.789472 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.789429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-metrics-cert\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.789652 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.789501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-cert\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.789652 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.789566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v77c\" (UniqueName: \"kubernetes.io/projected/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-kube-api-access-4v77c\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.789652 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.789610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-manager-config\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.891208 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.891157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v77c\" (UniqueName: \"kubernetes.io/projected/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-kube-api-access-4v77c\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.891365 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.891231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-manager-config\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.891365 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.891304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-metrics-cert\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.891471 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.891374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-cert\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.891924 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.891901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-manager-config\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.893844 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.893812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-metrics-cert\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.893965 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.893877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-cert\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:51.907013 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:51.906961 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v77c\" (UniqueName: \"kubernetes.io/projected/b4aa540f-f9df-47b3-a2ce-fc7ace003f4e-kube-api-access-4v77c\") pod \"lws-controller-manager-54784dbd95-cxwxw\" (UID: \"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e\") " pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:52.018848 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:52.018729 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:52.161700 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:52.161661 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw"] Jun 13 02:08:52.164687 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:08:52.164662 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4aa540f_f9df_47b3_a2ce_fc7ace003f4e.slice/crio-e25407c2ea6c68e1b87d7b627614982e51476b4fbbfbc8c12c55ae4b7a0ec362 WatchSource:0}: Error finding container e25407c2ea6c68e1b87d7b627614982e51476b4fbbfbc8c12c55ae4b7a0ec362: Status 404 returned error can't find the container with id e25407c2ea6c68e1b87d7b627614982e51476b4fbbfbc8c12c55ae4b7a0ec362 Jun 13 02:08:52.491638 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:52.491602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" event={"ID":"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e","Type":"ContainerStarted","Data":"e25407c2ea6c68e1b87d7b627614982e51476b4fbbfbc8c12c55ae4b7a0ec362"} Jun 13 02:08:55.509400 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:55.509364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" event={"ID":"b4aa540f-f9df-47b3-a2ce-fc7ace003f4e","Type":"ContainerStarted","Data":"1899073f0cede2e5216a93394e4c137fb3e5a1fcc5632999df97aa4147cbe7b2"} Jun 13 02:08:55.509824 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:55.509423 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:08:55.527817 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:08:55.527756 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" podStartSLOduration=2.073967779 podStartE2EDuration="4.527738807s" totalImagesPullingTime="2.453771028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:08:55.525686314 +0000 UTC m=+481.244903147" watchObservedRunningTime="2026-06-13 02:08:55.527738807 +0000 UTC m=+481.246955587" Jun 13 02:09:02.222891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.222852 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f59d458f8-sp689"] Jun 13 02:09:02.226989 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.226951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.229799 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.229772 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 02:09:02.229799 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.229771 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 02:09:02.230053 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.229825 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 02:09:02.231220 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.231198 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 02:09:02.231220 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.231218 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lng9b\"" Jun 13 02:09:02.241292 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.241263 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f59d458f8-sp689"] Jun 13 02:09:02.396597 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.396552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79knw\" (UniqueName: \"kubernetes.io/projected/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-kube-api-access-79knw\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.396810 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.396643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tmp\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.396810 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.396712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.498248 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.498152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.498428 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.498248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79knw\" (UniqueName: \"kubernetes.io/projected/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-kube-api-access-79knw\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.498428 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.498302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tmp\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.498428 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:09:02.498320 2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 13 02:09:02.498428 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:09:02.498404 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tls-certs podName:c2e935a2-ee56-4ec4-a072-bbc042c2bb12 nodeName:}" failed. No retries permitted until 2026-06-13 02:09:02.998381377 +0000 UTC m=+488.717598148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tls-certs") pod "kube-auth-proxy-5f59d458f8-sp689" (UID: "c2e935a2-ee56-4ec4-a072-bbc042c2bb12") : secret "kube-auth-proxy-tls" not found Jun 13 02:09:02.500533 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.500511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tmp\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:02.512182 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:02.512147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79knw\" (UniqueName: \"kubernetes.io/projected/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-kube-api-access-79knw\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:03.002877 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:03.002836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:03.005307 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:03.005274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2e935a2-ee56-4ec4-a072-bbc042c2bb12-tls-certs\") pod \"kube-auth-proxy-5f59d458f8-sp689\" (UID: \"c2e935a2-ee56-4ec4-a072-bbc042c2bb12\") " pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:03.139938 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:03.139896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" Jun 13 02:09:03.298463 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:03.298427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f59d458f8-sp689"] Jun 13 02:09:03.300884 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:09:03.300859 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e935a2_ee56_4ec4_a072_bbc042c2bb12.slice/crio-b0d7572377a579231c35af4a273d7be42ee69b8a76edaaf8e2135f5dcb139b30 WatchSource:0}: Error finding container b0d7572377a579231c35af4a273d7be42ee69b8a76edaaf8e2135f5dcb139b30: Status 404 returned error can't find the container with id b0d7572377a579231c35af4a273d7be42ee69b8a76edaaf8e2135f5dcb139b30 Jun 13 02:09:03.547398 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:03.547361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" event={"ID":"c2e935a2-ee56-4ec4-a072-bbc042c2bb12","Type":"ContainerStarted","Data":"b0d7572377a579231c35af4a273d7be42ee69b8a76edaaf8e2135f5dcb139b30"} Jun 13 02:09:06.516667 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:06.516634 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54784dbd95-cxwxw" Jun 13 02:09:06.565343 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:06.565305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" event={"ID":"c2e935a2-ee56-4ec4-a072-bbc042c2bb12","Type":"ContainerStarted","Data":"209d6b91019c872fb5a284d1716546ffe10ee405f01ca277a0d4e312d0deaf7c"} Jun 13 02:09:06.582153 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:09:06.582097 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f59d458f8-sp689" podStartSLOduration=1.785249179 podStartE2EDuration="4.582076252s" totalImagesPullingTime="2.796827073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:09:06.580435558 +0000 UTC m=+492.299652364" watchObservedRunningTime="2026-06-13 02:09:06.582076252 +0000 UTC m=+492.301293036" Jun 13 02:10:29.819864 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.819827 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2"] Jun 13 02:10:29.823308 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.823290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:29.826489 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.826450 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 02:10:29.826603 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.826545 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pck82\"" Jun 13 02:10:29.826766 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.826753 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 02:10:29.843690 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.843659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2"] Jun 13 02:10:29.896163 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.896121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvf6\" (UniqueName: \"kubernetes.io/projected/5044cce4-7b15-4fb3-9884-24e87d0b1354-kube-api-access-zrvf6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:29.896389 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.896175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5044cce4-7b15-4fb3-9884-24e87d0b1354-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:29.997256 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.997214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5044cce4-7b15-4fb3-9884-24e87d0b1354-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:29.997437 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.997344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvf6\" (UniqueName: \"kubernetes.io/projected/5044cce4-7b15-4fb3-9884-24e87d0b1354-kube-api-access-zrvf6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:29.997700 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:29.997676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5044cce4-7b15-4fb3-9884-24e87d0b1354-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:30.005621 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:30.005594 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvf6\" (UniqueName: \"kubernetes.io/projected/5044cce4-7b15-4fb3-9884-24e87d0b1354-kube-api-access-zrvf6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:30.133876 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:30.133785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:30.288466 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:30.288431 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2"] Jun 13 02:10:30.291386 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:10:30.291354 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5044cce4_7b15_4fb3_9884_24e87d0b1354.slice/crio-ce8bccc0987aa9fb1422d2f5393881e84d78dd61a90452901bbe9853f082458f WatchSource:0}: Error finding container ce8bccc0987aa9fb1422d2f5393881e84d78dd61a90452901bbe9853f082458f: Status 404 returned error can't find the container with id ce8bccc0987aa9fb1422d2f5393881e84d78dd61a90452901bbe9853f082458f Jun 13 02:10:30.970535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:30.970489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" event={"ID":"5044cce4-7b15-4fb3-9884-24e87d0b1354","Type":"ContainerStarted","Data":"ce8bccc0987aa9fb1422d2f5393881e84d78dd61a90452901bbe9853f082458f"} Jun 13 02:10:40.016608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:40.016572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" event={"ID":"5044cce4-7b15-4fb3-9884-24e87d0b1354","Type":"ContainerStarted","Data":"1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491"} Jun 13 02:10:40.017029 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:40.016695 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:40.040477 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:40.040420 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" podStartSLOduration=2.016819109 podStartE2EDuration="11.04040407s" totalImagesPullingTime="9.023584961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:40.03784508 +0000 UTC m=+585.757061873" watchObservedRunningTime="2026-06-13 02:10:40.04040407 +0000 UTC m=+585.759620928" Jun 13 02:10:51.024031 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:51.023996 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:52.701468 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.701430 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2"] Jun 13 02:10:52.701992 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.701712 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" containerName="manager" containerID="cri-o://1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491" gracePeriod=2 Jun 13 02:10:52.712129 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.712098 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2"] Jun 13 02:10:52.720234 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:52.720184 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5044cce4-7b15-4fb3-9884-24e87d0b1354\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\": pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:52.731506 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.731477 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w"] Jun 13 02:10:52.731840 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.731829 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" containerName="manager" Jun 13 02:10:52.731881 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.731842 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" containerName="manager" Jun 13 02:10:52.731942 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.731931 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" containerName="manager" Jun 13 02:10:52.740489 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.740465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:52.749272 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.749238 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w"] Jun 13 02:10:52.752835 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.752808 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds"] Jun 13 02:10:52.756540 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.756517 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" Jun 13 02:10:52.759511 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.759488 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g9ms8\"" Jun 13 02:10:52.763387 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:52.763346 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" is forbidden: User \"system:node:ip-10-0-132-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-107.ec2.internal' and this object" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:52.766071 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:52.766027 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" is forbidden: User \"system:node:ip-10-0-132-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-107.ec2.internal' and this object" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:52.766535 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.766510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds"] Jun 13 02:10:52.807557 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.807522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkrc4\" (UniqueName: \"kubernetes.io/projected/e98e1910-9394-4818-9388-239a03a9e953-kube-api-access-fkrc4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmn2w\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:52.807694 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.807576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m9vl\" (UniqueName: \"kubernetes.io/projected/09f47c8d-b478-4593-96f3-727d53173d72-kube-api-access-8m9vl\") pod \"limitador-operator-controller-manager-859d7b78bd-vw7ds\" (UID: \"09f47c8d-b478-4593-96f3-727d53173d72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" Jun 13 02:10:52.807694 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.807625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e98e1910-9394-4818-9388-239a03a9e953-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmn2w\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:52.908347 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.908312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e98e1910-9394-4818-9388-239a03a9e953-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmn2w\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:52.908542 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.908411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkrc4\" (UniqueName: \"kubernetes.io/projected/e98e1910-9394-4818-9388-239a03a9e953-kube-api-access-fkrc4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmn2w\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:52.908542 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.908442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m9vl\" (UniqueName: \"kubernetes.io/projected/09f47c8d-b478-4593-96f3-727d53173d72-kube-api-access-8m9vl\") pod \"limitador-operator-controller-manager-859d7b78bd-vw7ds\" (UID: \"09f47c8d-b478-4593-96f3-727d53173d72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" Jun 13 02:10:52.908790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.908767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e98e1910-9394-4818-9388-239a03a9e953-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmn2w\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:52.918967 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.918931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m9vl\" (UniqueName: \"kubernetes.io/projected/09f47c8d-b478-4593-96f3-727d53173d72-kube-api-access-8m9vl\") pod \"limitador-operator-controller-manager-859d7b78bd-vw7ds\" (UID: \"09f47c8d-b478-4593-96f3-727d53173d72\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" Jun 13 02:10:52.920269 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.920250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkrc4\" (UniqueName: \"kubernetes.io/projected/e98e1910-9394-4818-9388-239a03a9e953-kube-api-access-fkrc4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmn2w\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:52.946919 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:52.946893 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:52.949612 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:52.949580 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" is forbidden: User \"system:node:ip-10-0-132-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-107.ec2.internal' and this object" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:53.009613 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.009488 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5044cce4-7b15-4fb3-9884-24e87d0b1354-extensions-socket-volume\") pod \"5044cce4-7b15-4fb3-9884-24e87d0b1354\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " Jun 13 02:10:53.009613 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.009575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrvf6\" (UniqueName: \"kubernetes.io/projected/5044cce4-7b15-4fb3-9884-24e87d0b1354-kube-api-access-zrvf6\") pod \"5044cce4-7b15-4fb3-9884-24e87d0b1354\" (UID: \"5044cce4-7b15-4fb3-9884-24e87d0b1354\") " Jun 13 02:10:53.010036 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.010003 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5044cce4-7b15-4fb3-9884-24e87d0b1354-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5044cce4-7b15-4fb3-9884-24e87d0b1354" (UID: "5044cce4-7b15-4fb3-9884-24e87d0b1354"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:10:53.011800 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.011777 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5044cce4-7b15-4fb3-9884-24e87d0b1354-kube-api-access-zrvf6" (OuterVolumeSpecName: "kube-api-access-zrvf6") pod "5044cce4-7b15-4fb3-9884-24e87d0b1354" (UID: "5044cce4-7b15-4fb3-9884-24e87d0b1354"). InnerVolumeSpecName "kube-api-access-zrvf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:10:53.078171 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.078134 2579 generic.go:356] "Generic (PLEG): container finished" podID="5044cce4-7b15-4fb3-9884-24e87d0b1354" containerID="1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491" exitCode=0 Jun 13 02:10:53.078347 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.078184 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:53.078347 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.078235 2579 scope.go:117] "RemoveContainer" containerID="1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491" Jun 13 02:10:53.084431 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:53.084398 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" is forbidden: User \"system:node:ip-10-0-132-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-107.ec2.internal' and this object" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:53.087012 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.086994 2579 scope.go:117] "RemoveContainer" containerID="1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491" Jun 13 02:10:53.087311 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:53.087289 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491\": container with ID starting with 1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491 not found: ID does not exist" containerID="1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491" Jun 13 02:10:53.087365 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.087321 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491"} err="failed to get container status \"1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491\": rpc error: code = NotFound desc = could not find container \"1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491\": container with ID starting with 1b62813b9e463671278c605c9868d6b043739b6ea78d5c721d0b9b7f3b2b3491 not found: ID does not exist" Jun 13 02:10:53.088924 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:53.088904 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" is forbidden: User \"system:node:ip-10-0-132-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-107.ec2.internal' and this object" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:53.092119 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.092099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:53.097737 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.097715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" Jun 13 02:10:53.110689 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.110665 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5044cce4-7b15-4fb3-9884-24e87d0b1354-extensions-socket-volume\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:10:53.110689 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.110690 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrvf6\" (UniqueName: \"kubernetes.io/projected/5044cce4-7b15-4fb3-9884-24e87d0b1354-kube-api-access-zrvf6\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:10:53.260433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.260279 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w"] Jun 13 02:10:53.263504 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:10:53.263473 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98e1910_9394_4818_9388_239a03a9e953.slice/crio-c7893a9ecf0d3997404471921fce3dbced301b9bd328a0789eca2ef5ff95cf74 WatchSource:0}: Error finding container c7893a9ecf0d3997404471921fce3dbced301b9bd328a0789eca2ef5ff95cf74: Status 404 returned error can't find the container with id c7893a9ecf0d3997404471921fce3dbced301b9bd328a0789eca2ef5ff95cf74 Jun 13 02:10:53.275778 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:53.275752 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds"] Jun 13 02:10:53.303253 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:10:53.303213 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f47c8d_b478_4593_96f3_727d53173d72.slice/crio-7cb8346cb38a0aa634d44eed8a7983a705edfd20e02e49b382f739a7a378197b WatchSource:0}: Error finding container 7cb8346cb38a0aa634d44eed8a7983a705edfd20e02e49b382f739a7a378197b: Status 404 returned error can't find the container with id 7cb8346cb38a0aa634d44eed8a7983a705edfd20e02e49b382f739a7a378197b Jun 13 02:10:54.086508 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.086452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" event={"ID":"e98e1910-9394-4818-9388-239a03a9e953","Type":"ContainerStarted","Data":"d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471"} Jun 13 02:10:54.086964 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.086527 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" event={"ID":"e98e1910-9394-4818-9388-239a03a9e953","Type":"ContainerStarted","Data":"c7893a9ecf0d3997404471921fce3dbced301b9bd328a0789eca2ef5ff95cf74"} Jun 13 02:10:54.086964 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.086697 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:10:54.087754 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.087726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" event={"ID":"09f47c8d-b478-4593-96f3-727d53173d72","Type":"ContainerStarted","Data":"7cb8346cb38a0aa634d44eed8a7983a705edfd20e02e49b382f739a7a378197b"} Jun 13 02:10:54.112059 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:54.112018 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" is forbidden: User \"system:node:ip-10-0-132-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-107.ec2.internal' and this object" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:54.113410 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.113358 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" podStartSLOduration=2.113336527 podStartE2EDuration="2.113336527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:54.109454869 +0000 UTC m=+599.828671671" watchObservedRunningTime="2026-06-13 02:10:54.113336527 +0000 UTC m=+599.832553309" Jun 13 02:10:54.697480 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:10:54.697441 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2bx2\" is forbidden: User \"system:node:ip-10-0-132-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-107.ec2.internal' and this object" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2bx2" Jun 13 02:10:54.699491 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.699444 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5044cce4-7b15-4fb3-9884-24e87d0b1354" path="/var/lib/kubelet/pods/5044cce4-7b15-4fb3-9884-24e87d0b1354/volumes" Jun 13 02:10:54.949571 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.949484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:10:54.950561 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.950532 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:10:54.957029 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.957003 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:10:54.957935 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:54.957914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:10:55.093873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:55.093833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" event={"ID":"09f47c8d-b478-4593-96f3-727d53173d72","Type":"ContainerStarted","Data":"8c59a8a460022f982ad57aa550e0edee9fae460c40e9efd10ce2219f66273698"} Jun 13 02:10:55.094351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:55.093926 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" Jun 13 02:10:55.110957 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:10:55.110904 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" podStartSLOduration=1.439243719 podStartE2EDuration="3.110888209s" totalImagesPullingTime="1.67164449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:10:55.110795284 +0000 UTC m=+600.830012088" watchObservedRunningTime="2026-06-13 02:10:55.110888209 +0000 UTC m=+600.830104990" Jun 13 02:11:05.096788 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:05.096755 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:11:06.101588 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:06.101553 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw7ds" Jun 13 02:11:10.794226 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:10.794186 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w"] Jun 13 02:11:10.794677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:10.794383 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" podUID="e98e1910-9394-4818-9388-239a03a9e953" containerName="manager" containerID="cri-o://d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471" gracePeriod=10 Jun 13 02:11:10.993574 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:10.993536 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s"] Jun 13 02:11:10.996861 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:10.996842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.009071 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.009041 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s"] Jun 13 02:11:11.075184 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.075090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1db5e3-9425-4004-95b5-e25000c791e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxr8s\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.075332 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.075183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2sv\" (UniqueName: \"kubernetes.io/projected/9e1db5e3-9425-4004-95b5-e25000c791e5-kube-api-access-2n2sv\") pod \"kuadrant-operator-controller-manager-86878c769f-xxr8s\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.176369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.176326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1db5e3-9425-4004-95b5-e25000c791e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxr8s\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.176568 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.176466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2sv\" (UniqueName: \"kubernetes.io/projected/9e1db5e3-9425-4004-95b5-e25000c791e5-kube-api-access-2n2sv\") pod \"kuadrant-operator-controller-manager-86878c769f-xxr8s\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.176795 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.176766 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1db5e3-9425-4004-95b5-e25000c791e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxr8s\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.191220 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.191185 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2sv\" (UniqueName: \"kubernetes.io/projected/9e1db5e3-9425-4004-95b5-e25000c791e5-kube-api-access-2n2sv\") pod \"kuadrant-operator-controller-manager-86878c769f-xxr8s\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.309280 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.309239 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:11.457391 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.457351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s"] Jun 13 02:11:11.461158 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:11:11.461115 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1db5e3_9425_4004_95b5_e25000c791e5.slice/crio-817204fab0ac14655717450d6b2e0923c57ce903cc42f1063b1107c1e57ed881 WatchSource:0}: Error finding container 817204fab0ac14655717450d6b2e0923c57ce903cc42f1063b1107c1e57ed881: Status 404 returned error can't find the container with id 817204fab0ac14655717450d6b2e0923c57ce903cc42f1063b1107c1e57ed881 Jun 13 02:11:11.591829 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.591806 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:11:11.679987 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.679946 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkrc4\" (UniqueName: \"kubernetes.io/projected/e98e1910-9394-4818-9388-239a03a9e953-kube-api-access-fkrc4\") pod \"e98e1910-9394-4818-9388-239a03a9e953\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " Jun 13 02:11:11.680164 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.680038 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e98e1910-9394-4818-9388-239a03a9e953-extensions-socket-volume\") pod \"e98e1910-9394-4818-9388-239a03a9e953\" (UID: \"e98e1910-9394-4818-9388-239a03a9e953\") " Jun 13 02:11:11.680463 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.680436 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98e1910-9394-4818-9388-239a03a9e953-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e98e1910-9394-4818-9388-239a03a9e953" (UID: "e98e1910-9394-4818-9388-239a03a9e953"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:11:11.682123 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.682100 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e98e1910-9394-4818-9388-239a03a9e953-kube-api-access-fkrc4" (OuterVolumeSpecName: "kube-api-access-fkrc4") pod "e98e1910-9394-4818-9388-239a03a9e953" (UID: "e98e1910-9394-4818-9388-239a03a9e953"). InnerVolumeSpecName "kube-api-access-fkrc4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:11:11.780670 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.780629 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkrc4\" (UniqueName: \"kubernetes.io/projected/e98e1910-9394-4818-9388-239a03a9e953-kube-api-access-fkrc4\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:11:11.780670 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:11.780664 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e98e1910-9394-4818-9388-239a03a9e953-extensions-socket-volume\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:11:12.176314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.176278 2579 generic.go:356] "Generic (PLEG): container finished" podID="e98e1910-9394-4818-9388-239a03a9e953" containerID="d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471" exitCode=0 Jun 13 02:11:12.176314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.176309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" event={"ID":"e98e1910-9394-4818-9388-239a03a9e953","Type":"ContainerDied","Data":"d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471"} Jun 13 02:11:12.176867 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.176321 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" Jun 13 02:11:12.176867 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.176369 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w" event={"ID":"e98e1910-9394-4818-9388-239a03a9e953","Type":"ContainerDied","Data":"c7893a9ecf0d3997404471921fce3dbced301b9bd328a0789eca2ef5ff95cf74"} Jun 13 02:11:12.176867 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.176397 2579 scope.go:117] "RemoveContainer" containerID="d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471" Jun 13 02:11:12.178333 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.178304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" event={"ID":"9e1db5e3-9425-4004-95b5-e25000c791e5","Type":"ContainerStarted","Data":"76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65"} Jun 13 02:11:12.178458 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.178360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" event={"ID":"9e1db5e3-9425-4004-95b5-e25000c791e5","Type":"ContainerStarted","Data":"817204fab0ac14655717450d6b2e0923c57ce903cc42f1063b1107c1e57ed881"} Jun 13 02:11:12.178458 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.178425 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:12.186089 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.186068 2579 scope.go:117] "RemoveContainer" containerID="d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471" Jun 13 02:11:12.186377 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:11:12.186359 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471\": container with ID starting with d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471 not found: ID does not exist" containerID="d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471" Jun 13 02:11:12.186459 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.186385 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471"} err="failed to get container status \"d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471\": rpc error: code = NotFound desc = could not find container \"d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471\": container with ID starting with d5aa26415fa0366e2b47fdbbe9d68ce37c4270b7d36df20953ebf8a16e05d471 not found: ID does not exist" Jun 13 02:11:12.200261 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.200205 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" podStartSLOduration=2.200186462 podStartE2EDuration="2.200186462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:12.199161151 +0000 UTC m=+617.918377953" watchObservedRunningTime="2026-06-13 02:11:12.200186462 +0000 UTC m=+617.919403243" Jun 13 02:11:12.215534 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.215498 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w"] Jun 13 02:11:12.217009 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.216965 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmn2w"] Jun 13 02:11:12.698453 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:12.698419 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e98e1910-9394-4818-9388-239a03a9e953" path="/var/lib/kubelet/pods/e98e1910-9394-4818-9388-239a03a9e953/volumes" Jun 13 02:11:23.186526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:23.186490 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:11:30.462043 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.462001 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mx8rd"] Jun 13 02:11:30.462433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.462388 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e98e1910-9394-4818-9388-239a03a9e953" containerName="manager" Jun 13 02:11:30.462433 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.462400 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e98e1910-9394-4818-9388-239a03a9e953" containerName="manager" Jun 13 02:11:30.462515 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.462477 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e98e1910-9394-4818-9388-239a03a9e953" containerName="manager" Jun 13 02:11:30.468578 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.468552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mx8rd" Jun 13 02:11:30.471352 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.471320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mftfz\"" Jun 13 02:11:30.472144 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.472118 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mx8rd"] Jun 13 02:11:30.544911 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.544874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nx9r\" (UniqueName: \"kubernetes.io/projected/c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b-kube-api-access-2nx9r\") pod \"authorino-58cd955675-mx8rd\" (UID: \"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b\") " pod="kuadrant-system/authorino-58cd955675-mx8rd" Jun 13 02:11:30.646360 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.646323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nx9r\" (UniqueName: \"kubernetes.io/projected/c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b-kube-api-access-2nx9r\") pod \"authorino-58cd955675-mx8rd\" (UID: \"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b\") " pod="kuadrant-system/authorino-58cd955675-mx8rd" Jun 13 02:11:30.655229 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.655196 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nx9r\" (UniqueName: \"kubernetes.io/projected/c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b-kube-api-access-2nx9r\") pod \"authorino-58cd955675-mx8rd\" (UID: \"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b\") " pod="kuadrant-system/authorino-58cd955675-mx8rd" Jun 13 02:11:30.788216 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.788123 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mx8rd" Jun 13 02:11:30.923915 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:30.923734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mx8rd"] Jun 13 02:11:30.926307 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:11:30.926277 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7b5e1d7_334c_43ee_a730_bbe8ffb2c61b.slice/crio-d70539533b893dd082fc31ef3354ed0b5be9e879917debee7c6b9ddfcc0f870a WatchSource:0}: Error finding container d70539533b893dd082fc31ef3354ed0b5be9e879917debee7c6b9ddfcc0f870a: Status 404 returned error can't find the container with id d70539533b893dd082fc31ef3354ed0b5be9e879917debee7c6b9ddfcc0f870a Jun 13 02:11:31.274152 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:31.274116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mx8rd" event={"ID":"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b","Type":"ContainerStarted","Data":"d70539533b893dd082fc31ef3354ed0b5be9e879917debee7c6b9ddfcc0f870a"} Jun 13 02:11:34.296126 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:34.296074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mx8rd" event={"ID":"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b","Type":"ContainerStarted","Data":"e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f"} Jun 13 02:11:34.311015 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:34.310930 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mx8rd" podStartSLOduration=1.09259744 podStartE2EDuration="4.310915682s" totalImagesPullingTime="3.218318242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:11:34.31030898 +0000 UTC m=+640.029525760" watchObservedRunningTime="2026-06-13 02:11:34.310915682 +0000 UTC m=+640.030132464" Jun 13 02:11:36.913673 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:36.913637 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mx8rd"] Jun 13 02:11:36.914098 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:36.913807 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mx8rd" podUID="c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b" containerName="authorino" containerID="cri-o://e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f" gracePeriod=30 Jun 13 02:11:37.167432 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.167364 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mx8rd" Jun 13 02:11:37.310568 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.310536 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nx9r\" (UniqueName: \"kubernetes.io/projected/c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b-kube-api-access-2nx9r\") pod \"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b\" (UID: \"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b\") " Jun 13 02:11:37.311351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.311316 2579 generic.go:356] "Generic (PLEG): container finished" podID="c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b" containerID="e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f" exitCode=0 Jun 13 02:11:37.311500 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.311393 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mx8rd" Jun 13 02:11:37.311500 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.311409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mx8rd" event={"ID":"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b","Type":"ContainerDied","Data":"e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f"} Jun 13 02:11:37.311500 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.311457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mx8rd" event={"ID":"c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b","Type":"ContainerDied","Data":"d70539533b893dd082fc31ef3354ed0b5be9e879917debee7c6b9ddfcc0f870a"} Jun 13 02:11:37.311500 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.311474 2579 scope.go:117] "RemoveContainer" containerID="e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f" Jun 13 02:11:37.312869 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.312845 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b-kube-api-access-2nx9r" (OuterVolumeSpecName: "kube-api-access-2nx9r") pod "c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b" (UID: "c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b"). InnerVolumeSpecName "kube-api-access-2nx9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:11:37.324011 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.323961 2579 scope.go:117] "RemoveContainer" containerID="e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f" Jun 13 02:11:37.324351 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:11:37.324328 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f\": container with ID starting with e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f not found: ID does not exist" containerID="e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f" Jun 13 02:11:37.324436 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.324361 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f"} err="failed to get container status \"e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f\": rpc error: code = NotFound desc = could not find container \"e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f\": container with ID starting with e2d5a6815c34ed18a10274ec61963675a3d8b67d57d7fc72868101b4a931b04f not found: ID does not exist" Jun 13 02:11:37.411627 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.411594 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nx9r\" (UniqueName: \"kubernetes.io/projected/c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b-kube-api-access-2nx9r\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:11:37.633396 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.633355 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mx8rd"] Jun 13 02:11:37.636684 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:37.636657 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mx8rd"] Jun 13 02:11:38.699260 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:11:38.699223 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b" path="/var/lib/kubelet/pods/c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b/volumes" Jun 13 02:12:25.832405 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.832365 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:12:25.832880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.832779 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b" containerName="authorino" Jun 13 02:12:25.832880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.832792 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b" containerName="authorino" Jun 13 02:12:25.832880 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.832863 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b5e1d7-334c-43ee-a730-bbe8ffb2c61b" containerName="authorino" Jun 13 02:12:25.834891 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.834874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:25.837798 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.837775 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 02:12:25.837798 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.837789 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 02:12:25.838008 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.837991 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 02:12:25.839315 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.839298 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2zwdb\"" Jun 13 02:12:25.845023 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.844996 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:12:25.960461 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:25.960421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv42m\" (UniqueName: \"kubernetes.io/projected/4a5049fa-899c-494f-adc2-400a2870ce51-kube-api-access-zv42m\") pod \"maas-keycloak-0\" (UID: \"4a5049fa-899c-494f-adc2-400a2870ce51\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:26.062002 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:26.061940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv42m\" (UniqueName: \"kubernetes.io/projected/4a5049fa-899c-494f-adc2-400a2870ce51-kube-api-access-zv42m\") pod \"maas-keycloak-0\" (UID: \"4a5049fa-899c-494f-adc2-400a2870ce51\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:26.070902 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:26.070866 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv42m\" (UniqueName: \"kubernetes.io/projected/4a5049fa-899c-494f-adc2-400a2870ce51-kube-api-access-zv42m\") pod \"maas-keycloak-0\" (UID: \"4a5049fa-899c-494f-adc2-400a2870ce51\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:26.144997 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:26.144880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:26.284855 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:26.284826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:12:26.286851 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:12:26.286809 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5049fa_899c_494f_adc2_400a2870ce51.slice/crio-96eee64e9a95d546fcf5d6cb51373917f2704ded9390219dce5b044d40cc573d WatchSource:0}: Error finding container 96eee64e9a95d546fcf5d6cb51373917f2704ded9390219dce5b044d40cc573d: Status 404 returned error can't find the container with id 96eee64e9a95d546fcf5d6cb51373917f2704ded9390219dce5b044d40cc573d Jun 13 02:12:26.542209 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:26.542165 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4a5049fa-899c-494f-adc2-400a2870ce51","Type":"ContainerStarted","Data":"96eee64e9a95d546fcf5d6cb51373917f2704ded9390219dce5b044d40cc573d"} Jun 13 02:12:32.580263 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:32.580219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4a5049fa-899c-494f-adc2-400a2870ce51","Type":"ContainerStarted","Data":"1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75"} Jun 13 02:12:32.599742 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:32.599677 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.454101235 podStartE2EDuration="7.59966041s" totalImagesPullingTime="6.145559175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:12:32.598175672 +0000 UTC m=+698.317392467" watchObservedRunningTime="2026-06-13 02:12:32.59966041 +0000 UTC m=+698.318877246" Jun 13 02:12:33.145711 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:33.145668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:33.147648 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:33.147610 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:34.145801 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:34.145746 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:35.146401 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:35.146352 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:36.145391 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:36.145343 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:36.145766 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:36.145730 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:37.146099 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:37.146039 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:38.145917 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:38.145865 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:39.146395 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:39.146344 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:40.145677 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:40.145615 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:41.145994 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:41.145916 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:42.145706 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:42.145661 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:43.146104 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:43.146053 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:44.145762 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:44.145706 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:45.146374 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:45.146321 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:46.145455 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:46.145400 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 13 02:12:47.249772 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:47.249705 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 02:12:47.267322 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:47.267266 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:12:57.255804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:12:57.255766 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:39.259540 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.259491 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-lzddd"] Jun 13 02:13:39.263580 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.263558 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" Jun 13 02:13:39.266846 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.266818 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-94rgb\"" Jun 13 02:13:39.267040 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.266822 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 02:13:39.272877 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.272849 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-lzddd"] Jun 13 02:13:39.375715 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.375679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf5dr\" (UniqueName: \"kubernetes.io/projected/7fb9e7ce-8e41-4518-a6b6-54be89bf91c9-kube-api-access-jf5dr\") pod \"payload-processing-699b6cd6c-lzddd\" (UID: \"7fb9e7ce-8e41-4518-a6b6-54be89bf91c9\") " pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" Jun 13 02:13:39.476702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.476665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf5dr\" (UniqueName: \"kubernetes.io/projected/7fb9e7ce-8e41-4518-a6b6-54be89bf91c9-kube-api-access-jf5dr\") pod \"payload-processing-699b6cd6c-lzddd\" (UID: \"7fb9e7ce-8e41-4518-a6b6-54be89bf91c9\") " pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" Jun 13 02:13:39.485267 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.485233 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf5dr\" (UniqueName: \"kubernetes.io/projected/7fb9e7ce-8e41-4518-a6b6-54be89bf91c9-kube-api-access-jf5dr\") pod \"payload-processing-699b6cd6c-lzddd\" (UID: \"7fb9e7ce-8e41-4518-a6b6-54be89bf91c9\") " pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" Jun 13 02:13:39.576400 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.576291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" Jun 13 02:13:39.716919 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.716890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-lzddd"] Jun 13 02:13:39.719535 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:13:39.719503 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb9e7ce_8e41_4518_a6b6_54be89bf91c9.slice/crio-0e61b04368aaaf6d8d09812f24665e7f20c9a37139116128764171784320777f WatchSource:0}: Error finding container 0e61b04368aaaf6d8d09812f24665e7f20c9a37139116128764171784320777f: Status 404 returned error can't find the container with id 0e61b04368aaaf6d8d09812f24665e7f20c9a37139116128764171784320777f Jun 13 02:13:39.721522 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.721504 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:13:39.943351 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:39.943308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" event={"ID":"7fb9e7ce-8e41-4518-a6b6-54be89bf91c9","Type":"ContainerStarted","Data":"0e61b04368aaaf6d8d09812f24665e7f20c9a37139116128764171784320777f"} Jun 13 02:13:42.960417 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:42.960382 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" event={"ID":"7fb9e7ce-8e41-4518-a6b6-54be89bf91c9","Type":"ContainerStarted","Data":"c1dd81ade499f5bff5662a5e93e12f92b8f3080c5dee330bf59dd9c8c77bde4f"} Jun 13 02:13:42.960839 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:42.960450 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" Jun 13 02:13:42.976097 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:42.976047 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" podStartSLOduration=1.787240747 podStartE2EDuration="3.976030284s" totalImagesPullingTime="2.188789537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:13:42.975769521 +0000 UTC m=+768.694986325" watchObservedRunningTime="2026-06-13 02:13:42.976030284 +0000 UTC m=+768.695247077" Jun 13 02:13:50.011165 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:50.011128 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:13:50.011612 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:50.011344 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" containerID="cri-o://1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75" gracePeriod=30 Jun 13 02:13:51.663821 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:51.663795 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:51.795175 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:51.795081 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv42m\" (UniqueName: \"kubernetes.io/projected/4a5049fa-899c-494f-adc2-400a2870ce51-kube-api-access-zv42m\") pod \"4a5049fa-899c-494f-adc2-400a2870ce51\" (UID: \"4a5049fa-899c-494f-adc2-400a2870ce51\") " Jun 13 02:13:51.797347 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:51.797320 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5049fa-899c-494f-adc2-400a2870ce51-kube-api-access-zv42m" (OuterVolumeSpecName: "kube-api-access-zv42m") pod "4a5049fa-899c-494f-adc2-400a2870ce51" (UID: "4a5049fa-899c-494f-adc2-400a2870ce51"). InnerVolumeSpecName "kube-api-access-zv42m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:13:51.896612 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:51.896580 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv42m\" (UniqueName: \"kubernetes.io/projected/4a5049fa-899c-494f-adc2-400a2870ce51-kube-api-access-zv42m\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:13:52.003199 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.003164 2579 generic.go:356] "Generic (PLEG): container finished" podID="4a5049fa-899c-494f-adc2-400a2870ce51" containerID="1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75" exitCode=143 Jun 13 02:13:52.003386 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.003211 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.003386 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.003248 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4a5049fa-899c-494f-adc2-400a2870ce51","Type":"ContainerDied","Data":"1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75"} Jun 13 02:13:52.003386 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.003300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4a5049fa-899c-494f-adc2-400a2870ce51","Type":"ContainerDied","Data":"96eee64e9a95d546fcf5d6cb51373917f2704ded9390219dce5b044d40cc573d"} Jun 13 02:13:52.003386 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.003320 2579 scope.go:117] "RemoveContainer" containerID="1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75" Jun 13 02:13:52.012804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.012780 2579 scope.go:117] "RemoveContainer" containerID="1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75" Jun 13 02:13:52.013118 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:13:52.013096 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75\": container with ID starting with 1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75 not found: ID does not exist" containerID="1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75" Jun 13 02:13:52.013204 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.013127 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75"} err="failed to get container status \"1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75\": rpc error: code = NotFound desc = could not find container \"1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75\": container with ID starting with 1dc4e437d36a0a468ead72a57900db0d717980a0d8fe14ee5373f28c617d4f75 not found: ID does not exist" Jun 13 02:13:52.023885 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.023857 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:13:52.027634 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.027610 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:13:52.047668 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.047598 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:13:52.047981 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.047959 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" Jun 13 02:13:52.048019 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.047993 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" Jun 13 02:13:52.048093 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.048084 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" containerName="keycloak" Jun 13 02:13:52.052703 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.052682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.055790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.055762 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2zwdb\"" Jun 13 02:13:52.055790 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.055782 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 02:13:52.055947 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.055794 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 13 02:13:52.055947 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.055823 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 02:13:52.055947 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.055787 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 02:13:52.059845 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.059821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:13:52.199310 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.199274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0e328cd5-85f5-4676-b132-928d224867ce-test-realms\") pod \"maas-keycloak-0\" (UID: \"0e328cd5-85f5-4676-b132-928d224867ce\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.199487 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.199318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz746\" (UniqueName: \"kubernetes.io/projected/0e328cd5-85f5-4676-b132-928d224867ce-kube-api-access-vz746\") pod \"maas-keycloak-0\" (UID: \"0e328cd5-85f5-4676-b132-928d224867ce\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.299894 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.299790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0e328cd5-85f5-4676-b132-928d224867ce-test-realms\") pod \"maas-keycloak-0\" (UID: \"0e328cd5-85f5-4676-b132-928d224867ce\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.299894 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.299841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz746\" (UniqueName: \"kubernetes.io/projected/0e328cd5-85f5-4676-b132-928d224867ce-kube-api-access-vz746\") pod \"maas-keycloak-0\" (UID: \"0e328cd5-85f5-4676-b132-928d224867ce\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.300548 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.300526 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0e328cd5-85f5-4676-b132-928d224867ce-test-realms\") pod \"maas-keycloak-0\" (UID: \"0e328cd5-85f5-4676-b132-928d224867ce\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.307903 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.307880 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz746\" (UniqueName: \"kubernetes.io/projected/0e328cd5-85f5-4676-b132-928d224867ce-kube-api-access-vz746\") pod \"maas-keycloak-0\" (UID: \"0e328cd5-85f5-4676-b132-928d224867ce\") " pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.364106 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.364064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:52.500547 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.500522 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 02:13:52.502731 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:13:52.502703 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e328cd5_85f5_4676_b132_928d224867ce.slice/crio-734722b84b965c0c29961e574df1d98b74efc1221e39c19936c2b8d1dfb98207 WatchSource:0}: Error finding container 734722b84b965c0c29961e574df1d98b74efc1221e39c19936c2b8d1dfb98207: Status 404 returned error can't find the container with id 734722b84b965c0c29961e574df1d98b74efc1221e39c19936c2b8d1dfb98207 Jun 13 02:13:52.698817 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:52.698782 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a5049fa-899c-494f-adc2-400a2870ce51" path="/var/lib/kubelet/pods/4a5049fa-899c-494f-adc2-400a2870ce51/volumes" Jun 13 02:13:53.013418 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:53.013377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0e328cd5-85f5-4676-b132-928d224867ce","Type":"ContainerStarted","Data":"adbda19652bcc934687e8df48540d3c87fed5e76c5e40c59539e0130af2c4de6"} Jun 13 02:13:53.013608 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:53.013448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0e328cd5-85f5-4676-b132-928d224867ce","Type":"ContainerStarted","Data":"734722b84b965c0c29961e574df1d98b74efc1221e39c19936c2b8d1dfb98207"} Jun 13 02:13:53.033577 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:53.033524 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.638525363 podStartE2EDuration="1.033506467s" totalImagesPullingTime="394.981104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:13:53.032417416 +0000 UTC m=+778.751634217" watchObservedRunningTime="2026-06-13 02:13:53.033506467 +0000 UTC m=+778.752723274" Jun 13 02:13:53.364486 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:53.364383 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 02:13:53.365873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:53.365837 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:13:53.967776 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:53.967726 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-lzddd" Jun 13 02:13:54.365532 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:54.365413 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:13:55.365163 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:55.365046 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:13:56.365226 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:56.365168 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:13:57.364674 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:57.364622 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:13:58.365350 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:58.365297 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:13:59.365265 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:13:59.365208 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:00.365119 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:00.364903 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:01.365555 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:01.365501 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:02.364447 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:02.364402 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 02:14:02.364736 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:02.364699 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:03.365443 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:03.365386 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:04.364924 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:04.364863 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:05.365314 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:05.365259 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:06.365166 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:06.365069 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.32:9000/health/started\": dial tcp 10.134.0.32:9000: connect: connection refused" Jun 13 02:14:07.496705 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:07.496660 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 02:14:07.513784 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:07.513728 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0e328cd5-85f5-4676-b132-928d224867ce" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 02:14:17.503960 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:17.503911 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 02:14:47.045762 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.045725 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk"] Jun 13 02:14:47.049308 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.049285 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.053431 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.053397 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 13 02:14:47.053604 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.053446 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 02:14:47.053604 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.053461 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 02:14:47.053604 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.053411 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vzrsj\"" Jun 13 02:14:47.056448 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.056423 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk"] Jun 13 02:14:47.118329 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.118293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.118564 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.118355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.118564 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.118433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hsxv\" (UniqueName: \"kubernetes.io/projected/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-kube-api-access-4hsxv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.118564 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.118545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.118704 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.118588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.118704 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.118623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.219514 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.219476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.219739 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.219531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.219739 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.219573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.219739 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.219631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.219739 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.219674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.219739 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.219699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hsxv\" (UniqueName: \"kubernetes.io/projected/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-kube-api-access-4hsxv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.220112 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.220083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.220172 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.220120 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.220172 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.220093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.222001 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.221941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.222233 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.222214 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.228226 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.228203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hsxv\" (UniqueName: \"kubernetes.io/projected/2842965b-a8ef-4c9a-944f-0bbaa11fb9ad-kube-api-access-4hsxv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk\" (UID: \"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.361049 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.360935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:47.509581 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:47.509553 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk"] Jun 13 02:14:47.512459 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:14:47.512425 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2842965b_a8ef_4c9a_944f_0bbaa11fb9ad.slice/crio-3e3f7e1b67bf9f5d4b513319d028bb5b0a358df1176c43e8d8563c57e65164df WatchSource:0}: Error finding container 3e3f7e1b67bf9f5d4b513319d028bb5b0a358df1176c43e8d8563c57e65164df: Status 404 returned error can't find the container with id 3e3f7e1b67bf9f5d4b513319d028bb5b0a358df1176c43e8d8563c57e65164df Jun 13 02:14:48.317466 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:48.317429 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" event={"ID":"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad","Type":"ContainerStarted","Data":"3e3f7e1b67bf9f5d4b513319d028bb5b0a358df1176c43e8d8563c57e65164df"} Jun 13 02:14:52.342116 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:52.342014 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" event={"ID":"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad","Type":"ContainerStarted","Data":"bf4a11d81ba9fe1065b4d2391d46144d6f85da780a10516e22ac78991b03b1e1"} Jun 13 02:14:54.353518 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:54.353477 2579 generic.go:356] "Generic (PLEG): container finished" podID="2842965b-a8ef-4c9a-944f-0bbaa11fb9ad" containerID="bf4a11d81ba9fe1065b4d2391d46144d6f85da780a10516e22ac78991b03b1e1" exitCode=0 Jun 13 02:14:54.353901 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:54.353541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" event={"ID":"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad","Type":"ContainerDied","Data":"bf4a11d81ba9fe1065b4d2391d46144d6f85da780a10516e22ac78991b03b1e1"} Jun 13 02:14:56.366622 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:56.366580 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" event={"ID":"2842965b-a8ef-4c9a-944f-0bbaa11fb9ad","Type":"ContainerStarted","Data":"c9a8a81e8e5e87c4a3a213830e510c92f4d79fc9a066134f6559de5380ce3055"} Jun 13 02:14:56.384873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:56.384812 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" podStartSLOduration=2.497890901 podStartE2EDuration="9.384789451s" totalImagesPullingTime="5.593923769s" totalInitContainerRuntime="1.292974781s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:14:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:14:56.382702281 +0000 UTC m=+842.101919072" watchObservedRunningTime="2026-06-13 02:14:56.384789451 +0000 UTC m=+842.104006232" Jun 13 02:14:57.361107 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:57.361063 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:57.361305 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:57.361146 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:57.373886 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:57.373855 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:14:58.387103 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:14:58.387073 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk" Jun 13 02:15:05.349066 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.349024 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks"] Jun 13 02:15:05.353000 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.352955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.355837 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.355816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 13 02:15:05.361526 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.361491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks"] Jun 13 02:15:05.495246 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.495206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.495411 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.495278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe91b672-7d1d-4e9e-aa80-190a4bc50315-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.495411 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.495305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.495527 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.495447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.495527 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.495508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6nz\" (UniqueName: \"kubernetes.io/projected/fe91b672-7d1d-4e9e-aa80-190a4bc50315-kube-api-access-rx6nz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.495626 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.495604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.596379 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.596331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.596570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.596477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.596570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.596504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6nz\" (UniqueName: \"kubernetes.io/projected/fe91b672-7d1d-4e9e-aa80-190a4bc50315-kube-api-access-rx6nz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.596570 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.596555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.596745 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.596591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.596745 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.596612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe91b672-7d1d-4e9e-aa80-190a4bc50315-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.597065 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.597031 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.597065 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.597046 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.597279 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.597073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.598654 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.598631 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe91b672-7d1d-4e9e-aa80-190a4bc50315-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.599172 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.599130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe91b672-7d1d-4e9e-aa80-190a4bc50315-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.604619 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.604594 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6nz\" (UniqueName: \"kubernetes.io/projected/fe91b672-7d1d-4e9e-aa80-190a4bc50315-kube-api-access-rx6nz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks\" (UID: \"fe91b672-7d1d-4e9e-aa80-190a4bc50315\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.664828 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.664780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:15:05.807709 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:05.807670 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks"] Jun 13 02:15:05.810614 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:15:05.810584 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe91b672_7d1d_4e9e_aa80_190a4bc50315.slice/crio-1d5f6a03799c6883952cef899bdfa252dda852b51a17756f3d8c82361aba4826 WatchSource:0}: Error finding container 1d5f6a03799c6883952cef899bdfa252dda852b51a17756f3d8c82361aba4826: Status 404 returned error can't find the container with id 1d5f6a03799c6883952cef899bdfa252dda852b51a17756f3d8c82361aba4826 Jun 13 02:15:06.420965 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:06.420932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" event={"ID":"fe91b672-7d1d-4e9e-aa80-190a4bc50315","Type":"ContainerStarted","Data":"b98193657684ee36cce6ab7ac70a002df3c293f07153352acd0f99ea82370015"} Jun 13 02:15:06.421375 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:06.421037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" event={"ID":"fe91b672-7d1d-4e9e-aa80-190a4bc50315","Type":"ContainerStarted","Data":"1d5f6a03799c6883952cef899bdfa252dda852b51a17756f3d8c82361aba4826"} Jun 13 02:15:08.639324 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.639287 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv"] Jun 13 02:15:08.644404 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.644379 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.647231 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.647208 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 13 02:15:08.652542 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.652310 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv"] Jun 13 02:15:08.725385 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.725336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecbd6726-36f3-439f-ba41-3be8fd84bed7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.725574 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.725395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.725574 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.725451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.725574 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.725488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgr9w\" (UniqueName: \"kubernetes.io/projected/ecbd6726-36f3-439f-ba41-3be8fd84bed7-kube-api-access-sgr9w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.725574 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.725543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.725769 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.725585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.826762 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.826716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecbd6726-36f3-439f-ba41-3be8fd84bed7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827006 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.826772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827006 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.826806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827006 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.826833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgr9w\" (UniqueName: \"kubernetes.io/projected/ecbd6726-36f3-439f-ba41-3be8fd84bed7-kube-api-access-sgr9w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827006 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.826875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827006 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.826916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827354 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.827330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827423 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.827382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.827476 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.827420 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.829244 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.829223 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecbd6726-36f3-439f-ba41-3be8fd84bed7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.829658 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.829638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecbd6726-36f3-439f-ba41-3be8fd84bed7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.834861 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.834836 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgr9w\" (UniqueName: \"kubernetes.io/projected/ecbd6726-36f3-439f-ba41-3be8fd84bed7-kube-api-access-sgr9w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv\" (UID: \"ecbd6726-36f3-439f-ba41-3be8fd84bed7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:08.957317 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:08.957275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:15:09.104849 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:09.104812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv"] Jun 13 02:15:09.107368 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:15:09.107333 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbd6726_36f3_439f_ba41_3be8fd84bed7.slice/crio-efaea5762e2a29455cc6f54bd29c2edfd1f638649649cb936a58d4027079a09c WatchSource:0}: Error finding container efaea5762e2a29455cc6f54bd29c2edfd1f638649649cb936a58d4027079a09c: Status 404 returned error can't find the container with id efaea5762e2a29455cc6f54bd29c2edfd1f638649649cb936a58d4027079a09c Jun 13 02:15:09.435744 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:09.435701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" event={"ID":"ecbd6726-36f3-439f-ba41-3be8fd84bed7","Type":"ContainerStarted","Data":"dabe6147a56a9fdca3ad7a2f5cd787d2b332c8cb489b81513841fc95d007f21b"} Jun 13 02:15:09.435921 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:09.435771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" event={"ID":"ecbd6726-36f3-439f-ba41-3be8fd84bed7","Type":"ContainerStarted","Data":"efaea5762e2a29455cc6f54bd29c2edfd1f638649649cb936a58d4027079a09c"} Jun 13 02:15:54.979417 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:54.979384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:15:54.981778 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:54.981754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:15:54.986663 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:54.986640 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:15:54.988987 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:54.988955 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:15:58.680038 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:58.680001 2579 generic.go:356] "Generic (PLEG): container finished" podID="fe91b672-7d1d-4e9e-aa80-190a4bc50315" containerID="b98193657684ee36cce6ab7ac70a002df3c293f07153352acd0f99ea82370015" exitCode=0 Jun 13 02:15:58.680455 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:58.680073 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" event={"ID":"fe91b672-7d1d-4e9e-aa80-190a4bc50315","Type":"ContainerDied","Data":"b98193657684ee36cce6ab7ac70a002df3c293f07153352acd0f99ea82370015"} Jun 13 02:15:59.687281 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:59.687247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" event={"ID":"fe91b672-7d1d-4e9e-aa80-190a4bc50315","Type":"ContainerStarted","Data":"3f09e7cf173d8bb9711c020e53aad83059fdb3d2ffbe2bdf895efa7d20658b89"} Jun 13 02:15:59.707231 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:15:59.707171 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" podStartSLOduration=2.46703787 podStartE2EDuration="54.707152317s" totalImagesPullingTime="176.903213ms" totalInitContainerRuntime="52.063211234s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:15:59.706141255 +0000 UTC m=+905.425358055" watchObservedRunningTime="2026-06-13 02:15:59.707152317 +0000 UTC m=+905.426369097" Jun 13 02:16:03.706729 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:03.706690 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecbd6726-36f3-439f-ba41-3be8fd84bed7" containerID="dabe6147a56a9fdca3ad7a2f5cd787d2b332c8cb489b81513841fc95d007f21b" exitCode=0 Jun 13 02:16:03.707169 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:03.706763 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" event={"ID":"ecbd6726-36f3-439f-ba41-3be8fd84bed7","Type":"ContainerDied","Data":"dabe6147a56a9fdca3ad7a2f5cd787d2b332c8cb489b81513841fc95d007f21b"} Jun 13 02:16:04.713105 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:04.713069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" event={"ID":"ecbd6726-36f3-439f-ba41-3be8fd84bed7","Type":"ContainerStarted","Data":"20b433c3a140eeafa276d4fd879ba5e36f56d9c02b439271c4a1a328338732bc"} Jun 13 02:16:04.732646 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:04.732586 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" podStartSLOduration=2.26534451 podStartE2EDuration="56.732568234s" totalImagesPullingTime="182.602466ms" totalInitContainerRuntime="54.284621258s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:16:04.730328252 +0000 UTC m=+910.449545070" watchObservedRunningTime="2026-06-13 02:16:04.732568234 +0000 UTC m=+910.451785014" Jun 13 02:16:05.665426 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:05.665374 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:16:05.667596 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:05.665450 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:16:05.678355 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:05.678324 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:16:05.729836 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:05.729802 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks" Jun 13 02:16:08.957392 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:08.957348 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:16:08.957834 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:08.957417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:16:08.970217 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:08.970186 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:16:09.746989 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:16:09.746942 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv" Jun 13 02:20:55.014005 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:20:55.013953 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:20:55.014589 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:20:55.014402 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:20:55.022508 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:20:55.022473 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:20:55.023382 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:20:55.023361 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:25:55.048031 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:25:55.048003 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:25:55.050243 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:25:55.050218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:25:55.056100 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:25:55.056078 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:25:55.059804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:25:55.059782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:28:09.284603 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.284565 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s"] Jun 13 02:28:09.287190 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.284761 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" podUID="9e1db5e3-9425-4004-95b5-e25000c791e5" containerName="manager" containerID="cri-o://76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65" gracePeriod=10 Jun 13 02:28:09.550687 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.550656 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:28:09.589742 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.589702 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n2sv\" (UniqueName: \"kubernetes.io/projected/9e1db5e3-9425-4004-95b5-e25000c791e5-kube-api-access-2n2sv\") pod \"9e1db5e3-9425-4004-95b5-e25000c791e5\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " Jun 13 02:28:09.589916 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.589788 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1db5e3-9425-4004-95b5-e25000c791e5-extensions-socket-volume\") pod \"9e1db5e3-9425-4004-95b5-e25000c791e5\" (UID: \"9e1db5e3-9425-4004-95b5-e25000c791e5\") " Jun 13 02:28:09.590234 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.590201 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1db5e3-9425-4004-95b5-e25000c791e5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e1db5e3-9425-4004-95b5-e25000c791e5" (UID: "9e1db5e3-9425-4004-95b5-e25000c791e5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 02:28:09.591849 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.591824 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e1db5e3-9425-4004-95b5-e25000c791e5-kube-api-access-2n2sv" (OuterVolumeSpecName: "kube-api-access-2n2sv") pod "9e1db5e3-9425-4004-95b5-e25000c791e5" (UID: "9e1db5e3-9425-4004-95b5-e25000c791e5"). InnerVolumeSpecName "kube-api-access-2n2sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:28:09.690921 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.690875 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n2sv\" (UniqueName: \"kubernetes.io/projected/9e1db5e3-9425-4004-95b5-e25000c791e5-kube-api-access-2n2sv\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:28:09.690921 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:09.690910 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1db5e3-9425-4004-95b5-e25000c791e5-extensions-socket-volume\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:28:10.289735 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.289693 2579 generic.go:356] "Generic (PLEG): container finished" podID="9e1db5e3-9425-4004-95b5-e25000c791e5" containerID="76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65" exitCode=0 Jun 13 02:28:10.290185 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.289766 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" Jun 13 02:28:10.290185 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.289785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" event={"ID":"9e1db5e3-9425-4004-95b5-e25000c791e5","Type":"ContainerDied","Data":"76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65"} Jun 13 02:28:10.290185 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.289880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s" event={"ID":"9e1db5e3-9425-4004-95b5-e25000c791e5","Type":"ContainerDied","Data":"817204fab0ac14655717450d6b2e0923c57ce903cc42f1063b1107c1e57ed881"} Jun 13 02:28:10.290185 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.289910 2579 scope.go:117] "RemoveContainer" containerID="76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65" Jun 13 02:28:10.299572 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.299551 2579 scope.go:117] "RemoveContainer" containerID="76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65" Jun 13 02:28:10.299859 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:28:10.299838 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65\": container with ID starting with 76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65 not found: ID does not exist" containerID="76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65" Jun 13 02:28:10.299924 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.299872 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65"} err="failed to get container status \"76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65\": rpc error: code = NotFound desc = could not find container \"76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65\": container with ID starting with 76e3acaa56295655c05f5404883e8ec97484cd891f8f1c3cb26627742503ee65 not found: ID does not exist" Jun 13 02:28:10.311585 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.311555 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s"] Jun 13 02:28:10.315444 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.315416 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxr8s"] Jun 13 02:28:10.698817 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:28:10.698783 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e1db5e3-9425-4004-95b5-e25000c791e5" path="/var/lib/kubelet/pods/9e1db5e3-9425-4004-95b5-e25000c791e5/volumes" Jun 13 02:30:00.133378 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.130606 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688630-427k7"] Jun 13 02:30:00.133378 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.131469 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e1db5e3-9425-4004-95b5-e25000c791e5" containerName="manager" Jun 13 02:30:00.133378 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.131495 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e1db5e3-9425-4004-95b5-e25000c791e5" containerName="manager" Jun 13 02:30:00.133378 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.131664 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e1db5e3-9425-4004-95b5-e25000c791e5" containerName="manager" Jun 13 02:30:00.135579 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.135555 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" Jun 13 02:30:00.138602 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.138576 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hkjhn\"" Jun 13 02:30:00.140851 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.140826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688630-427k7"] Jun 13 02:30:00.218147 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.218095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2lb5\" (UniqueName: \"kubernetes.io/projected/839fc03a-5707-4570-8d16-21ba6a66d6c0-kube-api-access-z2lb5\") pod \"maas-api-key-cleanup-29688630-427k7\" (UID: \"839fc03a-5707-4570-8d16-21ba6a66d6c0\") " pod="opendatahub/maas-api-key-cleanup-29688630-427k7" Jun 13 02:30:00.318889 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.318843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2lb5\" (UniqueName: \"kubernetes.io/projected/839fc03a-5707-4570-8d16-21ba6a66d6c0-kube-api-access-z2lb5\") pod \"maas-api-key-cleanup-29688630-427k7\" (UID: \"839fc03a-5707-4570-8d16-21ba6a66d6c0\") " pod="opendatahub/maas-api-key-cleanup-29688630-427k7" Jun 13 02:30:00.327937 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.327892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2lb5\" (UniqueName: \"kubernetes.io/projected/839fc03a-5707-4570-8d16-21ba6a66d6c0-kube-api-access-z2lb5\") pod \"maas-api-key-cleanup-29688630-427k7\" (UID: \"839fc03a-5707-4570-8d16-21ba6a66d6c0\") " pod="opendatahub/maas-api-key-cleanup-29688630-427k7" Jun 13 02:30:00.447951 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.447909 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" Jun 13 02:30:00.583218 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.583181 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688630-427k7"] Jun 13 02:30:00.586578 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:30:00.586549 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839fc03a_5707_4570_8d16_21ba6a66d6c0.slice/crio-b355572b456ecf03148536145c0c1815c7c41231b3da9ba5aa429934277f2272 WatchSource:0}: Error finding container b355572b456ecf03148536145c0c1815c7c41231b3da9ba5aa429934277f2272: Status 404 returned error can't find the container with id b355572b456ecf03148536145c0c1815c7c41231b3da9ba5aa429934277f2272 Jun 13 02:30:00.588476 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.588459 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:30:00.840408 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:00.840324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" event={"ID":"839fc03a-5707-4570-8d16-21ba6a66d6c0","Type":"ContainerStarted","Data":"b355572b456ecf03148536145c0c1815c7c41231b3da9ba5aa429934277f2272"} Jun 13 02:30:03.858123 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:03.858082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" event={"ID":"839fc03a-5707-4570-8d16-21ba6a66d6c0","Type":"ContainerStarted","Data":"ffea1be86897b8a918442164e55f3865b5cc054055575e49fc9744e900192ce5"} Jun 13 02:30:03.874275 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:03.874222 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" podStartSLOduration=1.491038072 podStartE2EDuration="3.874204813s" totalImagesPullingTime="2.383166741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:30:03.873496259 +0000 UTC m=+1749.592713067" watchObservedRunningTime="2026-06-13 02:30:03.874204813 +0000 UTC m=+1749.593421648" Jun 13 02:30:04.864853 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:04.864816 2579 generic.go:356] "Generic (PLEG): container finished" podID="839fc03a-5707-4570-8d16-21ba6a66d6c0" containerID="ffea1be86897b8a918442164e55f3865b5cc054055575e49fc9744e900192ce5" exitCode=0 Jun 13 02:30:04.865248 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:04.864903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" event={"ID":"839fc03a-5707-4570-8d16-21ba6a66d6c0","Type":"ContainerDied","Data":"ffea1be86897b8a918442164e55f3865b5cc054055575e49fc9744e900192ce5"} Jun 13 02:30:06.009593 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:06.009563 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" Jun 13 02:30:06.076741 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:06.076697 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2lb5\" (UniqueName: \"kubernetes.io/projected/839fc03a-5707-4570-8d16-21ba6a66d6c0-kube-api-access-z2lb5\") pod \"839fc03a-5707-4570-8d16-21ba6a66d6c0\" (UID: \"839fc03a-5707-4570-8d16-21ba6a66d6c0\") " Jun 13 02:30:06.078995 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:06.078953 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839fc03a-5707-4570-8d16-21ba6a66d6c0-kube-api-access-z2lb5" (OuterVolumeSpecName: "kube-api-access-z2lb5") pod "839fc03a-5707-4570-8d16-21ba6a66d6c0" (UID: "839fc03a-5707-4570-8d16-21ba6a66d6c0"). InnerVolumeSpecName "kube-api-access-z2lb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 02:30:06.178412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:06.178374 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2lb5\" (UniqueName: \"kubernetes.io/projected/839fc03a-5707-4570-8d16-21ba6a66d6c0-kube-api-access-z2lb5\") on node \"ip-10-0-132-107.ec2.internal\" DevicePath \"\"" Jun 13 02:30:06.875750 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:06.875720 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" Jun 13 02:30:06.875931 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:06.875758 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688630-427k7" event={"ID":"839fc03a-5707-4570-8d16-21ba6a66d6c0","Type":"ContainerDied","Data":"b355572b456ecf03148536145c0c1815c7c41231b3da9ba5aa429934277f2272"} Jun 13 02:30:06.875931 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:06.875805 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b355572b456ecf03148536145c0c1815c7c41231b3da9ba5aa429934277f2272" Jun 13 02:30:55.081562 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:55.081529 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:30:55.086093 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:55.086064 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:30:55.088924 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:55.088902 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:30:55.093375 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:30:55.093353 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:35:55.113569 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:35:55.113536 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:35:55.122487 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:35:55.122460 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:35:55.124574 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:35:55.124549 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:35:55.129669 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:35:55.129644 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:38:24.561087 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.560994 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx"] Jun 13 02:38:24.561657 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.561640 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839fc03a-5707-4570-8d16-21ba6a66d6c0" containerName="cleanup" Jun 13 02:38:24.561703 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.561660 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="839fc03a-5707-4570-8d16-21ba6a66d6c0" containerName="cleanup" Jun 13 02:38:24.561770 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.561759 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="839fc03a-5707-4570-8d16-21ba6a66d6c0" containerName="cleanup" Jun 13 02:38:24.565477 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.565459 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.568532 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.568507 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 02:38:24.570840 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.570815 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hkjhn\"" Jun 13 02:38:24.573381 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.573355 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx"] Jun 13 02:38:24.610473 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.610435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e834c3a7-b195-4d96-8a95-76764d4f23e9-openshift-service-ca\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.610649 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.610542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fck74\" (UniqueName: \"kubernetes.io/projected/e834c3a7-b195-4d96-8a95-76764d4f23e9-kube-api-access-fck74\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.610649 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.610636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e834c3a7-b195-4d96-8a95-76764d4f23e9-maas-api-tls\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.711316 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.711266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e834c3a7-b195-4d96-8a95-76764d4f23e9-maas-api-tls\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.711316 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.711312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e834c3a7-b195-4d96-8a95-76764d4f23e9-openshift-service-ca\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.711594 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.711419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fck74\" (UniqueName: \"kubernetes.io/projected/e834c3a7-b195-4d96-8a95-76764d4f23e9-kube-api-access-fck74\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.712201 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.712168 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e834c3a7-b195-4d96-8a95-76764d4f23e9-openshift-service-ca\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.714255 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.714235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e834c3a7-b195-4d96-8a95-76764d4f23e9-maas-api-tls\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.730830 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.730800 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fck74\" (UniqueName: \"kubernetes.io/projected/e834c3a7-b195-4d96-8a95-76764d4f23e9-kube-api-access-fck74\") pod \"maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx\" (UID: \"e834c3a7-b195-4d96-8a95-76764d4f23e9\") " pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:24.879460 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:24.879360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:25.032540 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:25.032504 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx"] Jun 13 02:38:25.033139 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:38:25.033097 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode834c3a7_b195_4d96_8a95_76764d4f23e9.slice/crio-f3ce537284dabf2a4c568b1230131229fa91c4d8c4cf539abefa3e4b84ce7a51 WatchSource:0}: Error finding container f3ce537284dabf2a4c568b1230131229fa91c4d8c4cf539abefa3e4b84ce7a51: Status 404 returned error can't find the container with id f3ce537284dabf2a4c568b1230131229fa91c4d8c4cf539abefa3e4b84ce7a51 Jun 13 02:38:25.034558 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:25.034538 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 02:38:25.305296 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:25.305255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" event={"ID":"e834c3a7-b195-4d96-8a95-76764d4f23e9","Type":"ContainerStarted","Data":"f3ce537284dabf2a4c568b1230131229fa91c4d8c4cf539abefa3e4b84ce7a51"} Jun 13 02:38:28.325810 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:28.325775 2579 generic.go:356] "Generic (PLEG): container finished" podID="e834c3a7-b195-4d96-8a95-76764d4f23e9" containerID="1adcdb84e135df24be979ca24b986eec054f7c9b91e894fca073b52311d72a41" exitCode=1 Jun 13 02:38:28.326225 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:28.325868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" event={"ID":"e834c3a7-b195-4d96-8a95-76764d4f23e9","Type":"ContainerDied","Data":"1adcdb84e135df24be979ca24b986eec054f7c9b91e894fca073b52311d72a41"} Jun 13 02:38:28.326225 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:28.326148 2579 scope.go:117] "RemoveContainer" containerID="1adcdb84e135df24be979ca24b986eec054f7c9b91e894fca073b52311d72a41" Jun 13 02:38:29.332369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:29.332280 2579 generic.go:356] "Generic (PLEG): container finished" podID="e834c3a7-b195-4d96-8a95-76764d4f23e9" containerID="0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50" exitCode=1 Jun 13 02:38:29.332786 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:29.332371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" event={"ID":"e834c3a7-b195-4d96-8a95-76764d4f23e9","Type":"ContainerDied","Data":"0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50"} Jun 13 02:38:29.332786 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:29.332465 2579 scope.go:117] "RemoveContainer" containerID="1adcdb84e135df24be979ca24b986eec054f7c9b91e894fca073b52311d72a41" Jun 13 02:38:29.332786 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:29.332673 2579 scope.go:117] "RemoveContainer" containerID="0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50" Jun 13 02:38:29.332915 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:29.332884 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:38:29.879728 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:29.879686 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:30.342325 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:30.342292 2579 scope.go:117] "RemoveContainer" containerID="0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50" Jun 13 02:38:30.342705 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:30.342503 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:38:31.347522 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:31.347494 2579 scope.go:117] "RemoveContainer" containerID="0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50" Jun 13 02:38:31.347957 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:31.347742 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:38:34.879754 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:34.879715 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:34.880187 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:34.880128 2579 scope.go:117] "RemoveContainer" containerID="0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50" Jun 13 02:38:34.880353 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:34.880332 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:38:37.125444 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.125346 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9"] Jun 13 02:38:37.131138 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.131111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.141522 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.141492 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9"] Jun 13 02:38:37.233383 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.233340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-maas-api-tls\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.233569 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.233417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjsl4\" (UniqueName: \"kubernetes.io/projected/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-kube-api-access-cjsl4\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.233569 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.233478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-openshift-service-ca\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.334639 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.334591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjsl4\" (UniqueName: \"kubernetes.io/projected/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-kube-api-access-cjsl4\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.334842 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.334659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-openshift-service-ca\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.334842 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.334729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-maas-api-tls\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.335504 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.335473 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-openshift-service-ca\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.337353 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.337332 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-maas-api-tls\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.351829 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.351797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjsl4\" (UniqueName: \"kubernetes.io/projected/4c032cd1-e2c7-44ff-a4d2-2964f9beb705-kube-api-access-cjsl4\") pod \"maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9\" (UID: \"4c032cd1-e2c7-44ff-a4d2-2964f9beb705\") " pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.447491 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.447453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:37.589052 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:37.589010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9"] Jun 13 02:38:37.591965 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:38:37.591935 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c032cd1_e2c7_44ff_a4d2_2964f9beb705.slice/crio-a9d8219a0d1fbf6b11c40c9f20abef425c906df55b8f7a1677143c50d6aa6b6e WatchSource:0}: Error finding container a9d8219a0d1fbf6b11c40c9f20abef425c906df55b8f7a1677143c50d6aa6b6e: Status 404 returned error can't find the container with id a9d8219a0d1fbf6b11c40c9f20abef425c906df55b8f7a1677143c50d6aa6b6e Jun 13 02:38:38.383764 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:38.383726 2579 generic.go:356] "Generic (PLEG): container finished" podID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" containerID="7db86219a09ee4531f23bdd4af8b8f358885394a2784d8e00d85c26b61a1a22f" exitCode=1 Jun 13 02:38:38.384273 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:38.383809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" event={"ID":"4c032cd1-e2c7-44ff-a4d2-2964f9beb705","Type":"ContainerDied","Data":"7db86219a09ee4531f23bdd4af8b8f358885394a2784d8e00d85c26b61a1a22f"} Jun 13 02:38:38.384273 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:38.383870 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" event={"ID":"4c032cd1-e2c7-44ff-a4d2-2964f9beb705","Type":"ContainerStarted","Data":"a9d8219a0d1fbf6b11c40c9f20abef425c906df55b8f7a1677143c50d6aa6b6e"} Jun 13 02:38:38.384273 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:38.384078 2579 scope.go:117] "RemoveContainer" containerID="7db86219a09ee4531f23bdd4af8b8f358885394a2784d8e00d85c26b61a1a22f" Jun 13 02:38:39.391417 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:39.391334 2579 generic.go:356] "Generic (PLEG): container finished" podID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" containerID="dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7" exitCode=1 Jun 13 02:38:39.391823 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:39.391419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" event={"ID":"4c032cd1-e2c7-44ff-a4d2-2964f9beb705","Type":"ContainerDied","Data":"dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7"} Jun 13 02:38:39.391823 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:39.391487 2579 scope.go:117] "RemoveContainer" containerID="7db86219a09ee4531f23bdd4af8b8f358885394a2784d8e00d85c26b61a1a22f" Jun 13 02:38:39.391823 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:39.391685 2579 scope.go:117] "RemoveContainer" containerID="dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7" Jun 13 02:38:39.391957 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:39.391925 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:38:40.398905 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:40.398876 2579 scope.go:117] "RemoveContainer" containerID="dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7" Jun 13 02:38:40.399297 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:40.399099 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:38:42.448124 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:42.448077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:42.448558 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:42.448543 2579 scope.go:117] "RemoveContainer" containerID="dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7" Jun 13 02:38:42.448761 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:42.448741 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:38:47.448425 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:47.448389 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:38:47.449014 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:47.448909 2579 scope.go:117] "RemoveContainer" containerID="dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7" Jun 13 02:38:47.449203 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:47.449176 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:38:48.693206 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:48.693174 2579 scope.go:117] "RemoveContainer" containerID="0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50" Jun 13 02:38:49.443641 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:49.443608 2579 generic.go:356] "Generic (PLEG): container finished" podID="e834c3a7-b195-4d96-8a95-76764d4f23e9" containerID="38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6" exitCode=1 Jun 13 02:38:49.443816 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:49.443681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" event={"ID":"e834c3a7-b195-4d96-8a95-76764d4f23e9","Type":"ContainerDied","Data":"38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6"} Jun 13 02:38:49.443816 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:49.443770 2579 scope.go:117] "RemoveContainer" containerID="0107167645e0c001d8cb0519b30b01d27c80e43575a9df5f3667f017fe9d4f50" Jun 13 02:38:49.444204 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:49.444189 2579 scope.go:117] "RemoveContainer" containerID="38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6" Jun 13 02:38:49.444393 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:49.444372 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:38:49.879966 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:49.879926 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:50.450140 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:50.450110 2579 scope.go:117] "RemoveContainer" containerID="38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6" Jun 13 02:38:50.450386 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:50.450362 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:38:54.879541 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:54.879494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:38:54.880016 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:38:54.879928 2579 scope.go:117] "RemoveContainer" containerID="38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6" Jun 13 02:38:54.880180 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:38:54.880157 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:39:01.491483 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:01.491451 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_4c032cd1-e2c7-44ff-a4d2-2964f9beb705/maas-api/1.log" Jun 13 02:39:01.603556 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:01.603527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_e834c3a7-b195-4d96-8a95-76764d4f23e9/maas-api/2.log" Jun 13 02:39:01.815922 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:01.815845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688630-427k7_839fc03a-5707-4570-8d16-21ba6a66d6c0/cleanup/0.log" Jun 13 02:39:02.421855 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:02.421827 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-vjbc2_3d778542-1108-4df0-911e-577c32dfca62/copy-manifests/0.log" Jun 13 02:39:02.429716 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:02.429690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-vjbc2_3d778542-1108-4df0-911e-577c32dfca62/manager/0.log" Jun 13 02:39:02.693614 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:02.693534 2579 scope.go:117] "RemoveContainer" containerID="dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7" Jun 13 02:39:03.520779 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:03.520742 2579 generic.go:356] "Generic (PLEG): container finished" podID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" containerID="732811d55bcb9298cf4cdfc2da3848c8e23a47a9d8714e56e3519ec428d0f365" exitCode=1 Jun 13 02:39:03.520957 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:03.520785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" event={"ID":"4c032cd1-e2c7-44ff-a4d2-2964f9beb705","Type":"ContainerDied","Data":"732811d55bcb9298cf4cdfc2da3848c8e23a47a9d8714e56e3519ec428d0f365"} Jun 13 02:39:03.520957 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:03.520848 2579 scope.go:117] "RemoveContainer" containerID="dc32604699c94a02d70713994d7037a84fbca3574bb471334152297f4dc2d6c7" Jun 13 02:39:03.521250 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:03.521228 2579 scope.go:117] "RemoveContainer" containerID="732811d55bcb9298cf4cdfc2da3848c8e23a47a9d8714e56e3519ec428d0f365" Jun 13 02:39:03.521455 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:03.521427 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:39:04.747107 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:04.747068 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vw7ds_09f47c8d-b478-4593-96f3-727d53173d72/manager/0.log" Jun 13 02:39:05.428167 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:05.428133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-sp689_c2e935a2-ee56-4ec4-a072-bbc042c2bb12/kube-auth-proxy/0.log" Jun 13 02:39:05.783942 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:05.783839 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-lzddd_7fb9e7ce-8e41-4518-a6b6-54be89bf91c9/payload-processing/0.log" Jun 13 02:39:06.226267 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:06.226232 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk_2842965b-a8ef-4c9a-944f-0bbaa11fb9ad/storage-initializer/0.log" Jun 13 02:39:06.233237 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:06.233214 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-fcdvk_2842965b-a8ef-4c9a-944f-0bbaa11fb9ad/main/0.log" Jun 13 02:39:06.455189 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:06.455152 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks_fe91b672-7d1d-4e9e-aa80-190a4bc50315/storage-initializer/0.log" Jun 13 02:39:06.462244 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:06.462219 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vv4ks_fe91b672-7d1d-4e9e-aa80-190a4bc50315/main/0.log" Jun 13 02:39:06.574109 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:06.574023 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv_ecbd6726-36f3-439f-ba41-3be8fd84bed7/storage-initializer/0.log" Jun 13 02:39:06.581494 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:06.581464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cj2tqv_ecbd6726-36f3-439f-ba41-3be8fd84bed7/main/0.log" Jun 13 02:39:06.693060 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:06.693027 2579 scope.go:117] "RemoveContainer" containerID="38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6" Jun 13 02:39:06.693226 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:06.693200 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:39:07.448473 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:07.448432 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:39:07.448867 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:07.448492 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:39:07.448867 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:07.448848 2579 scope.go:117] "RemoveContainer" containerID="732811d55bcb9298cf4cdfc2da3848c8e23a47a9d8714e56e3519ec428d0f365" Jun 13 02:39:07.449070 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:07.449049 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:39:13.365227 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:13.365195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s4hxm_b246934d-7e12-4daf-80d9-a50d13b681df/global-pull-secret-syncer/0.log" Jun 13 02:39:13.474215 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:13.474180 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-twdwh_65b3a233-2155-4b55-ae6c-2d6f154e4327/konnectivity-agent/0.log" Jun 13 02:39:13.494939 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:13.494905 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-107.ec2.internal_634f28cc59756781be738094c6f0422f/haproxy/0.log" Jun 13 02:39:18.350228 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:18.350191 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vw7ds_09f47c8d-b478-4593-96f3-727d53173d72/manager/0.log" Jun 13 02:39:19.693370 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:19.693326 2579 scope.go:117] "RemoveContainer" containerID="38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6" Jun 13 02:39:19.693840 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:19.693442 2579 scope.go:117] "RemoveContainer" containerID="732811d55bcb9298cf4cdfc2da3848c8e23a47a9d8714e56e3519ec428d0f365" Jun 13 02:39:19.693840 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:19.693616 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:39:20.264523 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.264488 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-287mj_0cd1160d-48b3-44a6-9471-d070ceb2af7f/cluster-monitoring-operator/0.log" Jun 13 02:39:20.374114 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.374021 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-tcjpg_a6facac7-9ca7-4cfe-b65e-6b36c4ba49b3/monitoring-plugin/0.log" Jun 13 02:39:20.404185 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.404152 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkbp4_46a3b27f-0763-4000-a79a-52d1a4ebf406/node-exporter/0.log" Jun 13 02:39:20.447667 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.447636 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkbp4_46a3b27f-0763-4000-a79a-52d1a4ebf406/kube-rbac-proxy/0.log" Jun 13 02:39:20.475774 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.475747 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bkbp4_46a3b27f-0763-4000-a79a-52d1a4ebf406/init-textfile/0.log" Jun 13 02:39:20.607899 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.607868 2579 generic.go:356] "Generic (PLEG): container finished" podID="e834c3a7-b195-4d96-8a95-76764d4f23e9" containerID="d97e7e936ae0cf20d151178aa9e87cff65250c936b780bbbbf448026c7d16a2d" exitCode=1 Jun 13 02:39:20.608084 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.607945 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" event={"ID":"e834c3a7-b195-4d96-8a95-76764d4f23e9","Type":"ContainerDied","Data":"d97e7e936ae0cf20d151178aa9e87cff65250c936b780bbbbf448026c7d16a2d"} Jun 13 02:39:20.608084 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.608027 2579 scope.go:117] "RemoveContainer" containerID="38bac583302e39b71dc254e5f59562aae33545a5ce6cfe50bc68a22d542feca6" Jun 13 02:39:20.608362 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.608343 2579 scope.go:117] "RemoveContainer" containerID="d97e7e936ae0cf20d151178aa9e87cff65250c936b780bbbbf448026c7d16a2d" Jun 13 02:39:20.608551 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:20.608531 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:39:20.714909 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.714875 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42ad4945-e424-4379-8bc7-e5aace686d0e/prometheus/0.log" Jun 13 02:39:20.734416 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.734390 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42ad4945-e424-4379-8bc7-e5aace686d0e/config-reloader/0.log" Jun 13 02:39:20.757315 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.757288 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42ad4945-e424-4379-8bc7-e5aace686d0e/thanos-sidecar/0.log" Jun 13 02:39:20.777370 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.777345 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42ad4945-e424-4379-8bc7-e5aace686d0e/kube-rbac-proxy-web/0.log" Jun 13 02:39:20.797784 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.797753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42ad4945-e424-4379-8bc7-e5aace686d0e/kube-rbac-proxy/0.log" Jun 13 02:39:20.821545 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.821520 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42ad4945-e424-4379-8bc7-e5aace686d0e/kube-rbac-proxy-thanos/0.log" Jun 13 02:39:20.842651 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.842617 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_42ad4945-e424-4379-8bc7-e5aace686d0e/init-config-reloader/0.log" Jun 13 02:39:20.872648 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.872619 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-b6nzr_70661726-4073-4046-8487-4fac68c94a68/prometheus-operator/0.log" Jun 13 02:39:20.898804 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.898764 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-b6nzr_70661726-4073-4046-8487-4fac68c94a68/kube-rbac-proxy/0.log" Jun 13 02:39:20.955114 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.955023 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5d95d74-7h54p_cd6b4f24-4c29-4400-a628-43bf595e7ab4/telemeter-client/0.log" Jun 13 02:39:20.976307 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.976282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5d95d74-7h54p_cd6b4f24-4c29-4400-a628-43bf595e7ab4/reload/0.log" Jun 13 02:39:20.998478 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:20.998444 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cc5d95d74-7h54p_cd6b4f24-4c29-4400-a628-43bf595e7ab4/kube-rbac-proxy/0.log" Jun 13 02:39:21.029789 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:21.029757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/thanos-query/0.log" Jun 13 02:39:21.054181 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:21.054144 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy-web/0.log" Jun 13 02:39:21.074536 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:21.074509 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy/0.log" Jun 13 02:39:21.096697 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:21.096666 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/prom-label-proxy/0.log" Jun 13 02:39:21.113906 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:21.113877 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy-rules/0.log" Jun 13 02:39:21.134648 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:21.134611 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99d95bdb5-zk785_4d7b79e6-7449-47a0-b09c-f6aa4c3c3366/kube-rbac-proxy-metrics/0.log" Jun 13 02:39:23.421988 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:23.421943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/2.log" Jun 13 02:39:23.425798 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:23.425773 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-h8tqk_e4b3675a-8285-46c0-9dac-769eaa957c6b/console-operator/3.log" Jun 13 02:39:24.880376 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:24.880335 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:39:24.880828 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:24.880405 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" Jun 13 02:39:24.880828 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:24.880771 2579 scope.go:117] "RemoveContainer" containerID="d97e7e936ae0cf20d151178aa9e87cff65250c936b780bbbbf448026c7d16a2d" Jun 13 02:39:24.881029 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:24.881007 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:39:25.302525 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.302489 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk"] Jun 13 02:39:25.307674 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.307649 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.310567 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.310540 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc5tz\"/\"openshift-service-ca.crt\"" Jun 13 02:39:25.310690 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.310567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bc5tz\"/\"default-dockercfg-hn2ct\"" Jun 13 02:39:25.310690 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.310641 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc5tz\"/\"kube-root-ca.crt\"" Jun 13 02:39:25.316347 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.316320 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk"] Jun 13 02:39:25.395442 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.395397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-lib-modules\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.395632 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.395469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-proc\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.395632 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.395501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-sys\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.395632 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.395552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwxzn\" (UniqueName: \"kubernetes.io/projected/a422792c-8087-421d-8884-fea090b2c266-kube-api-access-cwxzn\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.395632 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.395581 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-podres\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497143 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwxzn\" (UniqueName: \"kubernetes.io/projected/a422792c-8087-421d-8884-fea090b2c266-kube-api-access-cwxzn\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497143 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-podres\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-lib-modules\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-proc\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-sys\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-podres\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497351 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-proc\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497369 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-sys\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.497595 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.497385 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a422792c-8087-421d-8884-fea090b2c266-lib-modules\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.505111 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.505085 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwxzn\" (UniqueName: \"kubernetes.io/projected/a422792c-8087-421d-8884-fea090b2c266-kube-api-access-cwxzn\") pod \"perf-node-gather-daemonset-26pbk\" (UID: \"a422792c-8087-421d-8884-fea090b2c266\") " pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.619349 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.619253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:25.759686 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.759650 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk"] Jun 13 02:39:25.761395 ip-10-0-132-107 kubenswrapper[2579]: W0613 02:39:25.761357 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda422792c_8087_421d_8884_fea090b2c266.slice/crio-35a6a675375d7b8cc37857704e8f920ac52538527056d670c41475c55b6a876f WatchSource:0}: Error finding container 35a6a675375d7b8cc37857704e8f920ac52538527056d670c41475c55b6a876f: Status 404 returned error can't find the container with id 35a6a675375d7b8cc37857704e8f920ac52538527056d670c41475c55b6a876f Jun 13 02:39:25.863089 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.863059 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nqt5_ffd37432-108b-4c57-9054-734f6e410e3e/dns/0.log" Jun 13 02:39:25.883008 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:25.882908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5nqt5_ffd37432-108b-4c57-9054-734f6e410e3e/kube-rbac-proxy/0.log" Jun 13 02:39:26.013384 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.013352 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fgwvw_b4f4d864-e019-4901-8bb1-950b3602add4/dns-node-resolver/0.log" Jun 13 02:39:26.521904 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.521868 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85956c6647-npmm6_6e52dd83-00e2-4e84-9ee6-e27b578d1ef1/registry/0.log" Jun 13 02:39:26.531078 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.531058 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85956c6647-npmm6_6e52dd83-00e2-4e84-9ee6-e27b578d1ef1/registry/1.log" Jun 13 02:39:26.597259 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.597233 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5kcn_cbe49d38-3643-4ad0-b4ef-951aa7985161/node-ca/0.log" Jun 13 02:39:26.644423 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.644384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" event={"ID":"a422792c-8087-421d-8884-fea090b2c266","Type":"ContainerStarted","Data":"1c90e048c50e8d9fa6514641966890f5b6647d4c5cf077bf1c42064b9b4198ba"} Jun 13 02:39:26.644605 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.644445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" event={"ID":"a422792c-8087-421d-8884-fea090b2c266","Type":"ContainerStarted","Data":"35a6a675375d7b8cc37857704e8f920ac52538527056d670c41475c55b6a876f"} Jun 13 02:39:26.644605 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.644471 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:26.660686 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:26.660628 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" podStartSLOduration=1.66061138 podStartE2EDuration="1.66061138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 02:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 02:39:26.659309992 +0000 UTC m=+2312.378526795" watchObservedRunningTime="2026-06-13 02:39:26.66061138 +0000 UTC m=+2312.379828160" Jun 13 02:39:27.588155 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:27.588117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-sp689_c2e935a2-ee56-4ec4-a072-bbc042c2bb12/kube-auth-proxy/0.log" Jun 13 02:39:27.757059 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:27.757023 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-lzddd_7fb9e7ce-8e41-4518-a6b6-54be89bf91c9/payload-processing/0.log" Jun 13 02:39:28.393194 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:28.393168 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dkn7z_f4ff27f7-358b-4260-a1f3-db51fb25c450/serve-healthcheck-canary/0.log" Jun 13 02:39:29.001914 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:29.001886 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6slw_f18a5afc-e14b-4e35-b4b8-4d690bff4c93/kube-rbac-proxy/0.log" Jun 13 02:39:29.022131 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:29.022106 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6slw_f18a5afc-e14b-4e35-b4b8-4d690bff4c93/exporter/0.log" Jun 13 02:39:29.043227 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:29.043201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6slw_f18a5afc-e14b-4e35-b4b8-4d690bff4c93/extractor/0.log" Jun 13 02:39:31.495333 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:31.495303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_4c032cd1-e2c7-44ff-a4d2-2964f9beb705/maas-api/2.log" Jun 13 02:39:31.495730 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:31.495303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_4c032cd1-e2c7-44ff-a4d2-2964f9beb705/maas-api/2.log" Jun 13 02:39:31.517673 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:31.517645 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_e834c3a7-b195-4d96-8a95-76764d4f23e9/maas-api/3.log" Jun 13 02:39:31.517673 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:31.517670 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_e834c3a7-b195-4d96-8a95-76764d4f23e9/maas-api/3.log" Jun 13 02:39:31.555795 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:31.555759 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688630-427k7_839fc03a-5707-4570-8d16-21ba6a66d6c0/cleanup/0.log" Jun 13 02:39:31.917928 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:31.917900 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-vjbc2_3d778542-1108-4df0-911e-577c32dfca62/manager/0.log" Jun 13 02:39:31.937325 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:31.937298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bc779c54-vjbc2_3d778542-1108-4df0-911e-577c32dfca62/copy-manifests/0.log" Jun 13 02:39:32.660026 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:32.659997 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bc5tz/perf-node-gather-daemonset-26pbk" Jun 13 02:39:32.693139 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:32.693101 2579 scope.go:117] "RemoveContainer" containerID="732811d55bcb9298cf4cdfc2da3848c8e23a47a9d8714e56e3519ec428d0f365" Jun 13 02:39:33.504336 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:33.504304 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54784dbd95-cxwxw_b4aa540f-f9df-47b3-a2ce-fc7ace003f4e/manager/0.log" Jun 13 02:39:33.682089 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:33.682053 2579 generic.go:356] "Generic (PLEG): container finished" podID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" containerID="3e07556373d972fabde8a31928d5edf7f42b61e2be274250fbf9fc373691bc2c" exitCode=1 Jun 13 02:39:33.682583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:33.682087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" event={"ID":"4c032cd1-e2c7-44ff-a4d2-2964f9beb705","Type":"ContainerDied","Data":"3e07556373d972fabde8a31928d5edf7f42b61e2be274250fbf9fc373691bc2c"} Jun 13 02:39:33.682583 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:33.682154 2579 scope.go:117] "RemoveContainer" containerID="732811d55bcb9298cf4cdfc2da3848c8e23a47a9d8714e56e3519ec428d0f365" Jun 13 02:39:33.682704 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:33.682689 2579 scope.go:117] "RemoveContainer" containerID="3e07556373d972fabde8a31928d5edf7f42b61e2be274250fbf9fc373691bc2c" Jun 13 02:39:33.682932 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:33.682906 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:39:37.448252 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:37.448213 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:39:37.448637 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:37.448281 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" Jun 13 02:39:37.448681 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:37.448645 2579 scope.go:117] "RemoveContainer" containerID="3e07556373d972fabde8a31928d5edf7f42b61e2be274250fbf9fc373691bc2c" Jun 13 02:39:37.448881 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:37.448859 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9_opendatahub(4c032cd1-e2c7-44ff-a4d2-2964f9beb705)\"" pod="opendatahub/maas-api-e2e-ait-17aed310-7cb6f7769c-vh5k9" podUID="4c032cd1-e2c7-44ff-a4d2-2964f9beb705" Jun 13 02:39:38.057894 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:38.057869 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-sp689_c2e935a2-ee56-4ec4-a072-bbc042c2bb12/kube-auth-proxy/0.log" Jun 13 02:39:38.215007 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:38.214954 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-lzddd_7fb9e7ce-8e41-4518-a6b6-54be89bf91c9/payload-processing/0.log" Jun 13 02:39:38.720455 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:38.720424 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-bjds9_144867f2-357f-47c0-978f-ae62e54ec1d2/migrator/0.log" Jun 13 02:39:38.745050 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:38.745016 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-bjds9_144867f2-357f-47c0-978f-ae62e54ec1d2/graceful-termination/0.log" Jun 13 02:39:39.564938 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:39.564879 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-sp689_c2e935a2-ee56-4ec4-a072-bbc042c2bb12/kube-auth-proxy/0.log" Jun 13 02:39:39.692711 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:39.692675 2579 scope.go:117] "RemoveContainer" containerID="d97e7e936ae0cf20d151178aa9e87cff65250c936b780bbbbf448026c7d16a2d" Jun 13 02:39:39.692908 ip-10-0-132-107 kubenswrapper[2579]: E0613 02:39:39.692846 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx_opendatahub(e834c3a7-b195-4d96-8a95-76764d4f23e9)\"" pod="opendatahub/maas-api-e2e-ait-c06ab60e-5d8d6f486b-n4kzx" podUID="e834c3a7-b195-4d96-8a95-76764d4f23e9" Jun 13 02:39:39.704824 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:39.704794 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-lzddd_7fb9e7ce-8e41-4518-a6b6-54be89bf91c9/payload-processing/0.log" Jun 13 02:39:40.278275 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.278245 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dv44v_753b8555-3e59-45a6-b8f4-46c97750e0ff/kube-multus-additional-cni-plugins/0.log" Jun 13 02:39:40.300548 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.300521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dv44v_753b8555-3e59-45a6-b8f4-46c97750e0ff/egress-router-binary-copy/0.log" Jun 13 02:39:40.319873 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.319841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dv44v_753b8555-3e59-45a6-b8f4-46c97750e0ff/cni-plugins/0.log" Jun 13 02:39:40.339741 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.339714 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dv44v_753b8555-3e59-45a6-b8f4-46c97750e0ff/bond-cni-plugin/0.log" Jun 13 02:39:40.358219 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.358187 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dv44v_753b8555-3e59-45a6-b8f4-46c97750e0ff/routeoverride-cni/0.log" Jun 13 02:39:40.377173 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.377147 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dv44v_753b8555-3e59-45a6-b8f4-46c97750e0ff/whereabouts-cni-bincopy/0.log" Jun 13 02:39:40.396918 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.396887 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dv44v_753b8555-3e59-45a6-b8f4-46c97750e0ff/whereabouts-cni/0.log" Jun 13 02:39:40.703475 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.703430 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bqn6k_d32077bd-301a-4aa2-8c38-441f240a4892/kube-multus/0.log" Jun 13 02:39:40.829895 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.829864 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vl5wj_75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a/network-metrics-daemon/0.log" Jun 13 02:39:40.848353 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:40.848327 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vl5wj_75840bbc-4e78-4b3a-bc97-3ac4e5fa5e2a/kube-rbac-proxy/0.log" Jun 13 02:39:41.360673 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:41.360588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f59d458f8-sp689_c2e935a2-ee56-4ec4-a072-bbc042c2bb12/kube-auth-proxy/0.log" Jun 13 02:39:41.504571 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:41.504499 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-lzddd_7fb9e7ce-8e41-4518-a6b6-54be89bf91c9/payload-processing/0.log" Jun 13 02:39:42.048308 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.048274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-controller/0.log" Jun 13 02:39:42.065498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.065448 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/1.log" Jun 13 02:39:42.065498 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.065451 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovn-acl-logging/0.log" Jun 13 02:39:42.084702 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.084675 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/kube-rbac-proxy-node/0.log" Jun 13 02:39:42.108832 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.108786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/kube-rbac-proxy-ovn-metrics/0.log" Jun 13 02:39:42.125412 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.125386 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/northd/0.log" Jun 13 02:39:42.147127 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.147099 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/nbdb/0.log" Jun 13 02:39:42.167021 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.166994 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/sbdb/0.log" Jun 13 02:39:42.207621 ip-10-0-132-107 kubenswrapper[2579]: I0613 02:39:42.207583 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gz2ss_232c873f-7a44-4e36-93ce-c6d1f6f5a855/ovnkube-controller/0.log"